Wayfair Product Scraper

Scrape product data including dimensions and specifications for any product on Wayfair.com

API Usage

The scraper is also available to use as an API. These parameters are accepted in the body

Request Body

Name	Description	Example
urls	Array of URLs of the product listings	[ "https://www.wayfair.com/furniture/pdp/serta-at-home-serta-copenhagen-modern-sofa-61-loveseat-couch-with-pillowed-back-cushions-and-rounded-arms-sert1056.html", "https://www.wayfair.com/furniture/pdp/hashtag-home-jandreau-716-square-arm-sleeper-w009823419.html", "https://www.wayfair.com/furniture/pdp/wade-logan-bobur-81-faux-leather-flared-arm-removable-cushion-sofa-w000124095.html", "https://www.wayfair.com/furniture/pdp/steelside-clark-80-genuine-leather-square-arm-sofa-w002004276.html", "https://www.wayfair.com/furniture/pdp/steelside-aisha-6968-faux-leather-square-arm-loveseat-idlh1098.html" ]
service_platform	Variable to indicate scraper platform name	wayfair_detail
webhook_url	Callback url where results will be posted on job completion. URL must accept post requests.	https://yourserverurl.com/path

Authentication

Set the following header for authentication:

Authorization: Token <your_api_key>

Example

Using the scraper via API requires a simple post request with the urls and service_platform details sent in the body of the request.

bash

1# Bash example to initiate a scraping job using cURL
2curl -X POST 'https://data.unwrangle.com/api/jobs/' \
3-H 'Authorization: Token <your_api_key_here>' \
4-H 'Content-Type: application/json' \
5-d '{
6  "urls": [
7    "https://www.wayfair.com/furniture/pdp/serta-at-home-serta-copenhagen-modern-sofa-61-loveseat-couch-with-pillowed-back-cushions-and-rounded-arms-sert1056.html",
8    "https://www.wayfair.com/furniture/pdp/hashtag-home-jandreau-716-square-arm-sleeper-w009823419.html",
9    "https://www.wayfair.com/furniture/pdp/wade-logan-bobur-81-faux-leather-flared-arm-removable-cushion-sofa-w000124095.html",
10    "https://www.wayfair.com/furniture/pdp/steelside-clark-80-genuine-leather-square-arm-sofa-w002004276.html",
11    "https://www.wayfair.com/furniture/pdp/steelside-aisha-6968-faux-leather-square-arm-loveseat-idlh1098.html"
12  ],
13  "service_platform": "wayfair_detail"
14}'

API Response

This is the response you will receive when a scraping job is created successfully.

json

1{
2  "created": "2024-06-10T09:19:40.161178Z",
3  "id": 27602,
4  "url": "https://www.wayfair.com/furniture/pdp/gracie-oaks-alvarado-52-wide-velvet-2-seater-straight-sofa-w004306979.html",
5  "search": null,
6  "urls": [],
7  "status": "queued",
8  "n": null,
9  "service_platform": "wayfair_detail",
10  "from_date": null,
11  "webhook_url": null,
12  "external_id": null,
13  "is_webhook_sent": false,
14  "credits_used": 10,
15  "completed": null
16}

Querying Results

The results retrieved by the scraping job can also be queried via API by making a request with the job ID in it if a webhook URL is not present.

bash

1curl -X GET 'https://data.unwrangle.com/api/jobs/27602/results/' \
2-H 'Authorization: Token <your_api_key>'

Request Cost

Each record returned will cost 100 credits and an additional 10 credits will be charged as a base fee for each job that is created