Scrape product information and details as a user would see them for any product on Lowes.com
The scraper is also available to use as an API. These parameters are accepted in the body
Name | Description | Example |
---|---|---|
urls | Array of URLs of the product listings | [ "https://www.lowes.com/pd/Kobalt-24V-Max-Brushless-Cordless-Drill/1000727668", "https://www.lowes.com/pd/CRAFTSMAN-20V-Max-Cordless-Drill/1000592439" ] |
service_platform | Variable to indicate scraper platform name | lowes_detail |
webhook_url | Callback URL where results will be posted upon job completion (must accept POST requests) | https://yourserverurl.com/path |
Set the following header for authentication:
Authorization: Token <your_api_key>
Login here to find your API key.
Using the scraper via API requires a simple POST request with the urls
and service_platform
details sent in the body of the request.
1curl -X POST 'https://data.unwrangle.com/api/jobs/' \2-H 'Authorization: Token <your_api_key_here>' \3-H 'Content-Type: application/json' \4-d '{5 "urls": [6 "https://www.lowes.com/pd/Kobalt-24V-Max-Brushless-Cordless-Drill/1000727668",7 "https://www.lowes.com/pd/CRAFTSMAN-20V-Max-Cordless-Drill/1000592439"8 ],9 "service_platform": "lowes_detail"10}'
This is the response you will receive when a scraping job is created successfully.
1{2 "created": "2024-06-10T09:19:40.161178Z",3 "id": 27606,4 "url": null,5 "search": null,6 "urls": [],7 "status": "queued",8 "n": null,9 "service_platform": "lowes_detail",10 "from_date": null,11 "webhook_url": null,12 "external_id": null,13 "is_webhook_sent": false,14 "credits_used": 10,15 "completed": null16}
The results retrieved by the scraping job can also be queried via API by making a request with the job ID if a webhook URL is not present.
1curl -X GET 'https://data.unwrangle.com/api/jobs/27606/results/' \2-H 'Authorization: Token <your_api_key>'
Each record returned will cost 10 credits, and an additional 10 credits will be charged as a base fee for each job that is created