
Amazon Product Scraper
- junglee/amazon-crawler
- Modified
- Users 3.7k
- Runs 30.8k
- Created by
Junglee
Use this Amazon scraper to collect data based on URL and country from the Amazon website. Extract product information without using the Amazon API, including reviews, prices, descriptions, and Amazon Standard Identification Numbers (ASINs). Download data in various structured formats.
What is Amazon Product Scraper and how does it work?
Amazon Product Scraper is a web scraping tool that enables you to extract product data from Amazon by using Amazon's subcategory URLs or product URLs.
For example, this is an Amazon URL for the Computer Monitors subcategory:
https://www.amazon.com/s?i=specialty-aps&bbn=16225007011&rh=n%3A16225007011%2Cn%3A1292115011
Amazon subcategories typically have /s
in the URL after the Amazon domain, so make sure your URL looks something like the example above.
So just add one or more Amazon URLs in the input field and select the maximum number of items you want to scrape. Then download the data from the output schema. You can even get this data via API without having to log in to the Apify platform.
Why scrape Amazon products?
Scraping Amazon products can help you to:
➡️ Monitor the performance of categories and subcategories on Amazon so you can put the performance of your products into context.
➡️ Discover up-and-coming brands and products to benchmark your performance within its category based on views, conversions, and reviews.
➡️ Fine-tune your advertising and messaging.
➡️ Use Amazon data to give you an edge in competitive intelligence.
For more inspiration, check out how web scraping is transforming e-commerce analytics.
7 pages Amazon limitation
Amazon sometimes restricts search terms to a maximum of 7 pages, please validate the number of pages in the URL. To overcome this limit, try to use one of the regular categories and combine it with the search terms. E.g. instead of just searching for Diamond rings
, find Jewelry
or Women's rings
category and combine them with the search term.
Is it legal to scrape Amazon?
It is legal to scrape publicly available data such as product descriptions, prices, or ratings. Read our blog post on the legality of web scraping to learn more.
How do I scrape products on Amazon?
This simple step-by-step guide shows you how to use Amazon Product Scraper.
Want more Amazon scraping options?
Try these 👇
Need to find product pairs between Amazon and another online shop?
Use the AI Product Matcher. This AI model allows you to compare items from different web stores, identifying exact matches and comparing real-time data obtained via web scraping. With the AI Product Matcher, you can use scraped product data to monitor product matches across the industry, implement dynamic pricing for your website, replace or complement manual mapping, and obtain realistic estimates against your competition for upcoming promo campaigns.
Most importantly, it is relatively easy to get started with (just follow this guide), and it can check thousands of pairs of products.
Input options
When running Amazon Product Scraper, you need to configure what you want to scrape and how it should be extracted. This input is provided either as a JSON file or in the editor on the Apify platform. Most input fields have reasonable default values.
For detailed descriptions and examples for all input fields, please visit the dedicated Input tab.
Please note the following when using Amazon Product Scraper:
- Price information might be missing if the delivery country has no sellers. Setting a specific "apifyProxyCountry" in proxy settings should help with this.
- There could still be differences in pricing depending on the US state.
- Amazon also shows different offers based on your proxy location.
Sample output from Amazon Product Scraper
{ "title": "SanDisk 1TB Extreme microSDXC UHS-I Memory Card with Adapter - Up to 190MB/s, C10, U3, V30, 4K, 5K, A2, Micro SD Card- SDSQXAV-1T00-GN6MA", "url": "https://www.amazon.com/dp/B09X7MPX8L", "asin": "B09X7MPX8L", "inStock": true, "inStockText": "Only 8 left in stock - order soon. Only 8 left in stock - order soon.", "brand": "SanDisk", "price": { "value": 145.5, "currency": "$" }, "listPrice": { "value": 299.99, "currency": "$" }, "shippingPrice": null, "stars": 4.8, "starsBreakdown": { "5star": 0.86, "4star": 0.09, "3star": 0.02, "2star": 0.01, "1star": 0.01 }, "reviewsCount": 36704, "answeredQuestions": 151, "breadCrumbs": "Electronics › Computers & Accessories › Computer Accessories & Peripherals › Memory Cards › Micro SD Cards", "thumbnailImage": "https://m.media-amazon.com/images/I/716kSUlHouL.__AC_SX300_SY300_QL70_FMwebp_.jpg", "description": null, "features": [ "Save time with card offload speeds of up to 190MB/s powered by SanDisk QuickFlow Technology (Up to 190MB/s read speeds, engineered with proprietary technology to reach speeds beyond UHS-I 104MB/s, requires compatible devices capable of reaching such speeds. Based on internal testing; performance may be lower depending upon host device interface, usage conditions and other factors. 1MB=1,000,000 bytes. SanDisk QuickFlow Technology is only available for 64GB, 128GB, 256GB, 400GB, 512GB, and 1TB capacities. 1GB=1,000,000,000 bytes and 1TB=1,000,000,000,000 bytes. Actual user storage less.)", "Pair with the SanDisk Professional PRO-READER SD and microSD to achieve maximum speeds (sold separately)", "Up to 130MB/s write speeds for fast shooting (Based on internal testing; performance may be lower depending upon host device interface, usage conditions and other factors. 1MB=1,000,000 bytes.)", "4K and 5K UHD-ready with UHS Speed Class 3 (U3) and Video Speed Class 30 (V30) (Compatible device required. Full HD (1920x1080), 4K UHD (3840 x 2160), and 5K UHD (5120 X 2880) support may vary based upon host device, file attributes and other factors. See HD page on SanDisk site. UHS Speed Class 3 (U3) designates a performance option designed to support real-time video recording with UHS-enabled host devices. Video Speed Class 30 (V30), sustained video capture rate of 30MB/s, designates a performance option designed to support real-time video recording with UHS-enabled host devices. See the SD Association’s official website.)", "Rated A2 for faster loading and in-app performance (A2 performance is 4000 read IOPS, 2000 write IOPS. Results may vary based on host device, app type and other factors)" ], "variantAsins": [], "reviewsLink": "/SanDisk-Extreme-microSDXC-Memory-Adapter/product-reviews/B09X7MPX8L?reviewerType=all_reviews", "delivery": "Thursday, January 26", "fastestDelivery": "Sunday, January 22", "returnPolicy": "Eligible for Return, Refund or Replacement within 30 days of receipt Eligible for Return, Refund or Replacement within 30 days of receipt", "support": "Free Amazon tech support included", "variantAttributes": [], "priceVariants": null, "seller": { "name": "Direct Suppliers US", "id": "A210SJF12S88M5", "url": "/gp/help/seller/at-a-glance.html/ref=dp_merchant_link?ie=UTF8&seller=A210SJF12S88M5&asin=B09X7MPX8L&ref_=dp_merchant_link&isAmazonFulfilled=1", "reviewsCount": null, "averageRating": null }, "bestsellerRanks": null, "locationText": "Select your address" }
Integrations and Amazon Product Scraper
Last but not least, Amazon Product Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. You can integrate with Make, Zapier, Slack, Airbyte, GitHub, Google Sheets, Google Drive, and more. Or you can use webhooks to carry out an action whenever an event occurs, e.g. get a notification whenever Instagram API Scraper successfully finishes a run.
Using Amazon Product Scraper with the Apify API
The Apify API gives you programmatic access to the Apify platform. The API is organized around RESTful HTTP endpoints that enable you to manage, schedule, and run Apify actors. The API also lets you access any datasets, monitor actor performance, fetch results, create and update versions, and more.
To access the API using Node.js, use the apify-client NPM package. To access the API using Python, use the apify-client PyPI package.
Check out the Apify API reference docs for full details or click on the API tab for code examples.
- What is Amazon Product Scraper and how does it work?
- Why scrape Amazon products?
- 7 pages Amazon limitation
- Is it legal to scrape Amazon?
- How do I scrape products on Amazon?
- Want more Amazon scraping options?
- Need to find product pairs between Amazon and another online shop?
- Input options
- Sample output from Amazon Product Scraper
- Integrations and Amazon Product Scraper
- Using Amazon Product Scraper with the Apify API