Amazon Product Scraper

What is Amazon Product Scraper and how does it work?

Amazon Product Scraper is a web scraping tool that enables you to extract product data from Amazon by using Amazon's subcategory URLs or product URLs.

For example, this is an Amazon URL for the Computer Monitors subcategory:

https://www.amazon.com/s?i=specialty-aps&bbn=16225007011&rh=n%3A16225007011%2Cn%3A1292115011

Amazon subcategories typically have /s in the URL after the Amazon domain, so make sure your URL looks something like the example above.

So just add one or more Amazon URLs in the input field and select the maximum number of items you want to scrape. Then download the data from the output schema. You can even get this data via API without having to log in to the Apify platform.

Why scrape Amazon products?

Scraping Amazon products can help you to:

➡️ Monitor the performance of categories and subcategories on Amazon so you can put the performance of your products into context.

➡️ Discover up-and-coming brands and products to benchmark your performance within its category based on views, conversions, and reviews.

➡️ Fine-tune your advertising and messaging.

➡️ Use Amazon data to give you an edge in competitive intelligence.

For more inspiration, check out how web scraping is transforming e-commerce analytics.

How many results can you scrape with Amazon Product Scraper?

Amazon Product Scraper can return over 100 000 results on average. However, you have to keep in mind that scraping amazon.com has many variables to it and may cause the results to fluctuate case by case. There’s no one-size-fits-all-use-cases number. The maximum number of results may vary depending on the complexity of the input, location, and other factors. Some of the most frequent cases are:

• website gives a different number of results depending on the type/value of the input
• website has an internal limit that no scraper can cross
• scraper has a limit that we are working on improving

Therefore, while we regularly run Actor tests to keep the benchmarks in check, the results may also fluctuate without our knowing. The best way to know for sure for your particular use case is to do a test run yourself.

How much will scraping Amazon Products cost you?

When it comes to scraping, it can be challenging to estimate the resources needed to extract data as use cases may vary significantly. That's why the best course of action is to run a test scrape with a small sample of input data and limited output. You’ll get your price per scrape, which you’ll then multiply by the number of scrapes you intend to do.

Watch this video for a few helpful tips. And don't forget that choosing a higher plan will save you money in the long run.

7 pages Amazon limitation

Amazon sometimes restricts search terms to a maximum of 7 pages, please validate the number of pages in the URL. To overcome this limit, try to use one of the regular categories and combine it with the search terms. E.g. instead of just searching for Diamond rings, find Jewelry or Women's rings category and combine them with the search term.

Is it legal to scrape Amazon?

It is legal to scrape publicly available data such as product descriptions, prices, or ratings. Read our blog post on the legality of web scraping to learn more.

How do I scrape products on Amazon?

This simple step-by-step guide shows you how to use Amazon Product Scraper.

Want more Amazon scraping options?

Try these 👇

• Amazon Best Sellers Scraper
• Amazon Reviews Scraper
• Amazon ASINs Scraper

Need to find product pairs between Amazon and another online shop?

Use the AI Product Matcher. This AI model allows you to compare items from different web stores, identifying exact matches and comparing real-time data obtained via web scraping. With the AI Product Matcher, you can use scraped product data to monitor product matches across the industry, implement dynamic pricing for your website, replace or complement manual mapping, and obtain realistic estimates against your competition for upcoming promo campaigns.

Most importantly, it is relatively easy to get started with (just follow this guide), and it can check thousands of pairs of products.

Input options

When running Amazon Product Scraper, you need to configure what you want to scrape and how it should be extracted. This input is provided either as a JSON file or in the editor on the Apify platform. Most input fields have reasonable default values.

For detailed descriptions and examples for all input fields, please visit the dedicated Input tab.

Please note the following when using Amazon Product Scraper:

• Price information might be missing if the delivery country has no sellers. Setting a specific "apifyProxyCountry" in proxy settings should help with this.
• There could still be differences in pricing depending on the US state.
• Amazon also shows different offers based on your proxy location.

Sample output from Amazon Product Scraper

1{
2    "title": "SanDisk 1TB Extreme microSDXC UHS-I Memory Card with Adapter - Up to 190MB/s, C10, U3, V30, 4K, 5K, A2, Micro SD Card- SDSQXAV-1T00-GN6MA",
3    "url": "https://www.amazon.com/dp/B09X7MPX8L",
4    "asin": "B09X7MPX8L",
5    "inStock": true,
6    "inStockText": "Only 8 left in stock - order soon.       Only 8 left in stock - order soon.",
7    "brand": "SanDisk",
8    "price": {
9        "value": 145.5,
10        "currency": "$"
11    },
12    "listPrice": {
13        "value": 299.99,
14        "currency": "$"
15    },
16    "shippingPrice": null,
17        "stars": 4.8,
18        "starsBreakdown": {
19        "5star": 0.86,
20        "4star": 0.09,
21        "3star": 0.02,
22        "2star": 0.01,
23        "1star": 0.01
24    },
25    "reviewsCount": 36704,
26    "answeredQuestions": 151,
27    "breadCrumbs": "Electronics › Computers & Accessories › Computer Accessories & Peripherals › Memory Cards › Micro SD Cards",
28    "thumbnailImage": "https://m.media-amazon.com/images/I/716kSUlHouL.__AC_SX300_SY300_QL70_FMwebp_.jpg",
29    "description": null,
30    "features": [
31    "Save time with card offload speeds of up to 190MB/s powered by SanDisk QuickFlow Technology (Up to 190MB/s read speeds, engineered with proprietary technology to reach speeds beyond UHS-I 104MB/s, requires compatible devices capable of reaching such speeds. Based on internal testing; performance may be lower depending upon host device interface, usage conditions and other factors. 1MB=1,000,000 bytes. SanDisk QuickFlow Technology is only available for 64GB, 128GB, 256GB, 400GB, 512GB, and 1TB capacities. 1GB=1,000,000,000 bytes and 1TB=1,000,000,000,000 bytes. Actual user storage less.)",
32    "Pair with the SanDisk Professional PRO-READER SD and microSD to achieve maximum speeds (sold separately)",
33    "Up to 130MB/s write speeds for fast shooting (Based on internal testing; performance may be lower depending upon host device interface, usage conditions and other factors. 1MB=1,000,000 bytes.)",
34    "4K and 5K UHD-ready with UHS Speed Class 3 (U3) and Video Speed Class 30 (V30) (Compatible device required. Full HD (1920x1080), 4K UHD (3840 x 2160), and 5K UHD (5120 X 2880) support may vary based upon host device, file attributes and other factors. See HD page on SanDisk site. UHS Speed Class 3 (U3) designates a performance option designed to support real-time video recording with UHS-enabled host devices. Video Speed Class 30 (V30), sustained video capture rate of 30MB/s, designates a performance option designed to support real-time video recording with UHS-enabled host devices. See the SD Association’s official website.)",
35    "Rated A2 for faster loading and in-app performance (A2 performance is 4000 read IOPS, 2000 write IOPS. Results may vary based on host device, app type and other factors)"
36    ],
37    "variantAsins": [],
38    "reviewsLink": "/SanDisk-Extreme-microSDXC-Memory-Adapter/product-reviews/B09X7MPX8L?reviewerType=all_reviews",
39    "delivery": "Thursday, January 26",
40    "fastestDelivery": "Sunday, January 22",
41    "returnPolicy": "Eligible for Return, Refund or Replacement within 30 days of receipt  Eligible for Return, Refund or Replacement within 30 days of receipt",
42    "support": "Free Amazon tech support included",
43    "variantAttributes": [],
44    "priceVariants": null,
45    "seller": {
46        "name": "Direct Suppliers US",
47        "id": "A210SJF12S88M5",
48        "url": "/gp/help/seller/at-a-glance.html/ref=dp_merchant_link?ie=UTF8&seller=A210SJF12S88M5&asin=B09X7MPX8L&ref_=dp_merchant_link&isAmazonFulfilled=1",
49        "reviewsCount": null,
50        "averageRating": null
51    },
52    "bestsellerRanks": null,
53    "locationText": "Select your address"
54}

Integrations and Amazon Product Scraper

Last but not least, Amazon Product Scraper can be connected with almost any cloud service or web app thanks to integrations on the Apify platform. You can integrate with Make, Zapier, Slack, Airbyte, GitHub, Google Sheets, Google Drive, and more. Or you can use webhooks to carry out an action whenever an event occurs, e.g. get a notification whenever Instagram API Scraper successfully finishes a run.

Using Amazon Product Scraper with the Apify API

The Apify API gives you programmatic access to the Apify platform. The API is organized around RESTful HTTP endpoints that enable you to manage, schedule, and run Apify actors. The API also lets you access any datasets, monitor actor performance, fetch results, create and update versions, and more.

To access the API using Node.js, use the apify-client NPM package. To access the API using Python, use the apify-client PyPI package.

Check out the Apify API reference docs for full details or click on the API tab for code examples.

Not your cup of tea? Build your own scraper

Amazon Product Scraper doesn’t exactly do what you need? You can always build your own! We have various scraper templates in Python, JavaScript, and TypeScript to get you started. Alternatively, you can write it from scratch using our open-source library Crawlee. You can keep the scraper to yourself or make it public by adding it to Apify Store (and find users for it).

Or let us know if you need a custom scraping solution.

Your feedback

We’re always working on improving the performance of our Actors. So if you’ve got any technical feedback for xxx or simply found a bug, please create an issue on the Actor’s Issues tab in Apify Console.