# Amazon Product Scraper (`joseforo/amazon-product-scraper`) Actor Scrape Amazon products from product URLs, category URLs, and search URLs into structured JSON. - **URL**: https://apify.com/joseforo/amazon-product-scraper.md - **Developed by:** [Josefo](https://apify.com/joseforo) (community) - **Categories:** E-commerce, Integrations - **Stats:** 2 total users, 1 monthly users, 0.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Amazon Product Scraper: Prices, ASINs, Reviews Extract Amazon product titles, ASINs, prices, availability, ratings, review counts, variants, bestseller ranks, sellers, images, and category data from product, search, and category URLs. This Actor is built for Amazon price monitoring, ASIN research, marketplace analytics, category tracking, competitor benchmarking, and e-commerce reporting. ![Apify automation test result](../docs/assets/apify-automation-test-result.svg) ### What You Get - scrape product URLs, search URLs, and category URLs - follow category/search pagination up to `maxPagesPerStartUrl` - deduplicate products by normalized ASIN URLs - extract price, list price, stock status, seller, stars, reviews, breadcrumbs, images, variants, and bestseller ranks - use marketplace country and proxy country hints for more consistent results - push clean JSON records and structured error records to the default Apify dataset ### High-Intent Keywords Amazon product scraper, Amazon price scraper, Amazon ASIN scraper, Amazon reviews scraper, Amazon bestseller rank scraper, Amazon category scraper, marketplace analytics, ecommerce product data. ### Input | Field | Type | Default | Description | | --- | --- | --- | --- | | `startUrls` | array | required | Product URLs, category URLs, or search URLs. | | `maxItems` | integer | `100` | Maximum number of products to scrape. | | `maxPagesPerStartUrl` | integer | `7` | Maximum category/search pages per start URL. | | `country` | string | `US` | Marketplace/proxy country hint. | | `includeReviewsBreakdown` | boolean | `true` | Extract star distribution where visible. | | `includeVariants` | boolean | `true` | Extract variant ASINs and attributes where visible. | | `includeBestsellerRanks` | boolean | `true` | Extract bestseller rank text where visible. | | `proxy` | object | Apify residential proxy | Proxy settings. | | `debug` | boolean | `false` | Save debug screenshots/HTML on failure. | Example input: ```json { "startUrls": [ { "url": "https://www.amazon.com/dp/B09X7MPX8L" }, { "url": "https://www.amazon.com/s?k=microSD+card" } ], "maxItems": 50, "maxPagesPerStartUrl": 3, "country": "US", "includeVariants": true, "includeBestsellerRanks": true } ```` ### Output Every product is pushed as a JSON record to the default Apify dataset. A complete sample is available at [../docs/examples/amazon-product-output.json](../docs/examples/amazon-product-output.json). ```json { "title": "SanDisk 1TB Extreme microSDXC UHS-I Memory Card with Adapter", "url": "https://www.amazon.com/dp/B09X7MPX8L", "asin": "B09X7MPX8L", "inStock": true, "brand": "SanDisk", "price": { "value": 145.5, "currency": "$" }, "listPrice": { "value": 299.99, "currency": "$" }, "stars": 4.8, "reviewsCount": 36704, "breadCrumbs": "Electronics > Computers & Accessories > Memory Cards", "features": ["Fast card offload speeds", "Designed for action cameras and drones"], "seller": { "name": "Amazon.com", "id": "ATVPDKIKX0DER" }, "bestsellerRanks": ["#1 in Micro SD Memory Cards"] } ``` Error records are pushed when a URL cannot be scraped: ```json { "error": "product_not_found", "errorDescription": "Loaded a 404 page. The product does not exist.", "input": "https://www.amazon.com/dp/B0XXXXXXXX", "url": "https://www.amazon.com/dp/B0XXXXXXXX" } ``` ### Use Cases - monitor prices and stock availability for competitor products - collect ASINs and product attributes from category pages - track bestseller ranks for product research - feed e-commerce dashboards and BI systems - benchmark ratings, review counts, sellers, and variants ### API Usage ```bash curl "https://api.apify.com/v2/acts/YOUR_USERNAME~amazon-product-scraper/runs?token=YOUR_APIFY_TOKEN" \ -H "Content-Type: application/json" \ -d '{"startUrls":[{"url":"https://www.amazon.com/dp/B09X7MPX8L"}],"maxItems":10,"country":"US"}' ``` ### Automation Test From the repository root: ```bash npm test ``` From this Actor directory: ```bash npm test ``` Expected result: ```text Marketing asset validation passed. ``` ### Store Growth Checklist - title includes the high-intent terms `Amazon Product Scraper`, `Prices`, `ASINs`, and `Reviews` - description names the valuable fields users search for - sample output is linked and includes bestseller rank, price, rating, seller, and ASIN data - README explains API usage, category monitoring, and structured error records - automation result image is embedded as visible test evidence ### Notes Amazon output can vary by marketplace, delivery location, proxy location, stock, seller availability, and page layout. For more consistent pricing, set the proxy country to the country you want to simulate. Amazon can limit some search result pages. If a keyword search stops after a small number of pages, use a regular category URL and combine it with the search term. # Actor input Schema ## `startUrls` (type: `array`): Amazon product URLs, category URLs, or search URLs. Category/search URLs often contain /s after the Amazon domain. ## `maxItems` (type: `integer`): Maximum number of product records to scrape across all input URLs. ## `maxPagesPerStartUrl` (type: `integer`): Amazon sometimes limits search results to about 7 pages. Use category URLs plus search terms for broader coverage. ## `country` (type: `string`): Amazon marketplace country code used for URL normalization and proxy country. ## `includeReviewsBreakdown` (type: `boolean`): Try to extract 5-star to 1-star review breakdown where visible. ## `includeVariants` (type: `boolean`): Try to extract variant ASINs and variant attributes from product pages. ## `includeBestsellerRanks` (type: `boolean`): Try to extract bestseller rank text from product detail pages. ## `proxy` (type: `object`): Apify Proxy configuration. Set apifyProxyCountry to your desired delivery country for more consistent prices. ## `debug` (type: `boolean`): Save screenshots and HTML snapshots when extraction fails. ## Actor input object example ```json { "startUrls": [ { "url": "https://www.amazon.com/s?i=specialty-aps&bbn=16225007011&rh=n%3A16225007011%2Cn%3A1292115011" } ], "maxItems": 100, "maxPagesPerStartUrl": 7, "country": "US", "includeReviewsBreakdown": true, "includeVariants": true, "includeBestsellerRanks": true, "proxy": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" }, "debug": false } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrls": [ { "url": "https://www.amazon.com/s?i=specialty-aps&bbn=16225007011&rh=n%3A16225007011%2Cn%3A1292115011" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("joseforo/amazon-product-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrls": [{ "url": "https://www.amazon.com/s?i=specialty-aps&bbn=16225007011&rh=n%3A16225007011%2Cn%3A1292115011" }] } # Run the Actor and wait for it to finish run = client.actor("joseforo/amazon-product-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrls": [ { "url": "https://www.amazon.com/s?i=specialty-aps&bbn=16225007011&rh=n%3A16225007011%2Cn%3A1292115011" } ] }' | apify call joseforo/amazon-product-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=joseforo/amazon-product-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Amazon Product Scraper", "description": "Scrape Amazon products from product URLs, category URLs, and search URLs into structured JSON.", "version": "0.1", "x-build-id": "ji3Achqc2CljIaDis" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/joseforo~amazon-product-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-joseforo-amazon-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/joseforo~amazon-product-scraper/runs": { "post": { "operationId": "runs-sync-joseforo-amazon-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/joseforo~amazon-product-scraper/run-sync": { "post": { "operationId": "run-sync-joseforo-amazon-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrls" ], "properties": { "startUrls": { "title": "Amazon URLs", "type": "array", "description": "Amazon product URLs, category URLs, or search URLs. Category/search URLs often contain /s after the Amazon domain.", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "maxItems": { "title": "Maximum products", "minimum": 1, "maximum": 100000, "type": "integer", "description": "Maximum number of product records to scrape across all input URLs.", "default": 100 }, "maxPagesPerStartUrl": { "title": "Maximum pages per category/search URL", "minimum": 1, "maximum": 50, "type": "integer", "description": "Amazon sometimes limits search results to about 7 pages. Use category URLs plus search terms for broader coverage.", "default": 7 }, "country": { "title": "Amazon marketplace", "type": "string", "description": "Amazon marketplace country code used for URL normalization and proxy country.", "default": "US" }, "includeReviewsBreakdown": { "title": "Include star breakdown", "type": "boolean", "description": "Try to extract 5-star to 1-star review breakdown where visible.", "default": true }, "includeVariants": { "title": "Include variants", "type": "boolean", "description": "Try to extract variant ASINs and variant attributes from product pages.", "default": true }, "includeBestsellerRanks": { "title": "Include bestseller ranks", "type": "boolean", "description": "Try to extract bestseller rank text from product detail pages.", "default": true }, "proxy": { "title": "Proxy configuration", "type": "object", "description": "Apify Proxy configuration. Set apifyProxyCountry to your desired delivery country for more consistent prices.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ], "apifyProxyCountry": "US" } }, "debug": { "title": "Debug", "type": "boolean", "description": "Save screenshots and HTML snapshots when extraction fails.", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```