Best Buy Product Scraper

Scrape product information and details as a user would see them for any product on BestBuy.com

API Usage

The scraper is also available to use as an API. These parameters are accepted in the body

Request Body

Name	Description	Example
urls	Array of URLs of the product listings	[ "https://www.bestbuy.com/site/apple-13-3-macbook-air-latest-model-with-touch-id-intel-core-i5-8gb-memory-256gb-solid-state-drive-space-gray/6366564.p?skuId=6366564", "https://www.bestbuy.com/site/samsung-65-class-q80b-quantum-led-4k-smart-tizen-tv/6501916.p?skuId=6501916" ]
service_platform	Variable to indicate scraper platform name	bestbuy_detail
webhook_url	Callback URL where results will be posted upon job completion (must accept POST requests)	https://yourserverurl.com/path

Authentication

Set the following header for authentication:

Authorization: Token <your_api_key>

Example

Using the scraper via API requires a simple POST request with the urls and service_platform details sent in the body of the request.

bash

1curl -X POST 'https://data.unwrangle.com/api/jobs/' \
2-H 'Authorization: Token <your_api_key_here>' \
3-H 'Content-Type: application/json' \
4-d '{
5  "urls": [
6    "https://www.bestbuy.com/site/apple-13-3-macbook-air-latest-model-with-touch-id-intel-core-i5-8gb-memory-256gb-solid-state-drive-space-gray/6366564.p?skuId=6366564",
7    "https://www.bestbuy.com/site/samsung-65-class-q80b-quantum-led-4k-smart-tizen-tv/6501916.p?skuId=6501916"
8  ],
9  "service_platform": "bestbuy_detail"
10}'

API Response

This is the response you will receive when a scraping job is created successfully.

json

1{
2  "created": "2024-06-10T09:19:40.161178Z",
3  "id": 27607,
4  "url": null,
5  "search": null,
6  "urls": [],
7  "status": "queued",
8  "n": null,
9  "service_platform": "bestbuy_detail",
10  "from_date": null,
11  "webhook_url": null,
12  "external_id": null,
13  "is_webhook_sent": false,
14  "credits_used": 10,
15  "completed": null
16}

Querying Results

The results retrieved by the scraping job can also be queried via API by making a request with the job ID if a webhook URL is not present.

bash

1curl -X GET 'https://data.unwrangle.com/api/jobs/27607/results/' \
2-H 'Authorization: Token <your_api_key>'

Request Cost

Each record returned will cost 10 credits, and an additional 10 credits will be charged as a base fee for each job that is created