# Amazon Scraper - Products, Prices & Reviews (.in & .com) (`fascinating_lentil/amazon-scraper`) Actor Scrape Amazon India (amazon.in) and Amazon US (amazon.com) for product data: titles, ASINs, prices, ratings, reviews, sellers, stock, images, specs, badges, and BSR. Search by keyword, ASIN list, or category URL. Residential proxies. Pay per result. - **URL**: https://apify.com/fascinating\_lentil/amazon-scraper.md - **Developed by:** [Md Jakaria Mirza](https://apify.com/fascinating_lentil) (community) - **Categories:** E-commerce, Lead generation, Marketing - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Amazon Scraper (.in & .com) - Products, Prices & Reviews A production-grade [Apify Actor](https://apify.com) for scraping Amazon India (`amazon.in`) and Amazon US (`amazon.com`) product data. It accepts search keywords, ASIN lists, category URLs, and product URLs, then returns structured product records with prices, ratings, seller data, stock status, images, specifications, badges, Best Seller Rank, and optional recent reviews. The Actor is designed for Apify Store publication with pay-per-event pricing: **$0.002 per successfully scraped product**. ### What It Extracts | Field | Type | Description | | --- | --- | --- | | `asin` | string | 10-character Amazon Standard Identification Number | | `title` | string | Full product title | | `url` | string | Canonical product page URL | | `domain` | string | `amazon.com` or `amazon.in` | | `keyword` | string | Search keyword that found the product, empty for ASIN/category input | | `price` | number | Current price | | `originalPrice` | number | List price or MRP before discount | | `discountPercent` | integer | Rounded discount percentage | | `currency` | string | ISO currency code such as `USD` or `INR` | | `rating` | number | Product rating | | `reviewsCount` | number | Total review count | | `sellerName` | string | Merchant or seller name | | `inStock` | boolean | Availability status | | `imageUrl` | string | Main product image | | `images` | string[] | Product gallery image URLs | | `category` | string | Breadcrumb category | | `brand` | string | Product brand | | `specifications` | object | Product specification key-value pairs | | `isAmazonsChoice` | boolean | Amazon's Choice badge status | | `isBestSeller` | boolean | Best Seller badge status | | `bestSellerRank` | string | Best Seller Rank text | | `reviews` | object[] | Optional recent reviews | | `scrapedAt` | string | ISO timestamp for the scrape | When `trackPriceHistory` is enabled, the Actor also saves a `_type: "price-snapshot"` row for each scraped product. ### Use Cases 1. Competitive price monitoring across Amazon US and India. 2. Review aggregation for product research, sentiment analysis, and complaint mining. 3. Catalog enrichment from ASIN lists. 4. Niche and category research using category or search URLs. 5. Stock, discount, rating, and seller tracking for ecommerce analytics. ### Pricing | Event | Price | | --- | --- | | `product-scraped` | `$0.002` per successfully saved product record | Examples: - 1,000 products = $2.00 - 10,000 products = $20.00 - 100,000 products = $200.00 Price snapshot rows are written for analytics, but the explicit charge event is tied to product records. ### Input Provide at least one of `searchKeyword`, `asinList`, or `categoryUrl`. `asinList` takes precedence, then `categoryUrl`, then `searchKeyword`. | Field | Type | Required | Default | Description | | --- | --- | --- | --- | --- | | `searchKeyword` | string[] | one of | `["echo dot"]` | One or more search terms | | `asinList` | string[] | one of | none | Direct ASINs | | `categoryUrl` | string | one of | none | Amazon category, search, or product URL | | `marketplace` | string | yes | `amazon.com` | `amazon.com` or `amazon.in`; inferred from `categoryUrl` when URL input is used | | `maxProducts` | integer | no | 100 | Product cap per keyword/category/ASIN list, 1-500 | | `includeReviews` | boolean | no | false | Fetch recent reviews per product | | `maxReviewsPerProduct` | integer | no | 10 | Review cap per product, 0-100 | | `trackPriceHistory` | boolean | no | true | Push a price snapshot row for each product | | `maxRequestsPerMinute` | integer | no | 30 | Crawl pacing, 5-30 | | `proxyConfig` | object | no | Apify residential proxy | Proxy settings passed to Apify/Crawlee | ### Example Inputs Keyword search: ```json { "searchKeyword": ["echo dot"], "marketplace": "amazon.com", "maxProducts": 20, "includeReviews": false, "proxyConfig": { "useApifyProxy": true, "apifyProxyGroups": ["RESIDENTIAL"] } } ```` ASIN enrichment with reviews: ```json { "asinList": ["B08N5WRWNW", "B09V3KXJPB", "B0BDHB9Y8H"], "marketplace": "amazon.com", "includeReviews": true, "maxReviewsPerProduct": 20 } ``` India category scrape: ```json { "categoryUrl": "https://www.amazon.in/s?i=electronics&rh=n%3A976419031", "maxProducts": 200, "trackPriceHistory": true, "maxRequestsPerMinute": 25 } ``` ### Sample Output ```json { "asin": "B08N5WRWNW", "title": "Echo Dot (5th Gen, 2022 release) | Smart speaker with Alexa", "url": "https://www.amazon.com/dp/B08N5WRWNW", "domain": "amazon.com", "keyword": "echo dot", "price": 49.99, "originalPrice": 59.99, "discountPercent": 17, "currency": "USD", "rating": 4.7, "reviewsCount": 15234, "sellerName": "Amazon.com", "inStock": true, "imageUrl": "https://m.media-amazon.com/images/I/example.jpg", "images": ["https://m.media-amazon.com/images/I/example.jpg"], "category": "Electronics > Smart Home > Speakers", "brand": "Amazon", "specifications": { "Brand": "Amazon", "Connectivity": "Wi-Fi, Bluetooth" }, "isAmazonsChoice": true, "isBestSeller": true, "bestSellerRank": "#1 in Smart Speakers", "reviews": [], "scrapedAt": "2026-06-08T00:00:00.000Z" } ``` Price snapshot row: ```json { "_type": "price-snapshot", "asin": "B08N5WRWNW", "domain": "amazon.com", "title": "Echo Dot (5th Gen, 2022 release)", "url": "https://www.amazon.com/dp/B08N5WRWNW", "price": 49.99, "originalPrice": 59.99, "discountPercent": 17, "currency": "USD", "inStock": true, "capturedAt": "2026-06-08T00:00:00.000Z" } ``` ### How It Works 1. Validates input and chooses the mode: ASIN, category/product URL, or keyword. 2. Infers the Amazon marketplace from URL input and rejects mismatched marketplace settings. 3. Starts a Playwright crawler with Apify proxy configuration, session pool, retries, and conservative pacing. 4. Collects search result ASINs up to the requested per-query cap. 5. Visits product detail pages and extracts structured product data. 6. Optionally visits review pages and appends recent reviews. 7. Saves product records using the `product-scraped` pay-per-event charge. 8. Optionally saves price snapshot rows for historical tracking. ### Anti-Bot Handling - Apify proxy support, with residential proxies recommended. - Crawlee session pool with bounded session usage. - CAPTCHA detection with request retry/session rotation. - Conservative navigation and scroll delays. - Multiple fallback selectors for Amazon layout drift. - Per-query product caps to avoid over-collecting beyond user input. ### Local Development ```bash npm install npm run build npm start ``` For local Apify simulation: ```bash apify run ``` For deployment: ```bash apify push ``` ### Project Structure ```text amazon-scraper/ .actor/ actor.json Dockerfile output_schema.json dataset_schema.json src/ main.ts routes.ts productScraper.ts reviewScraper.ts selectors.ts types.ts validation.ts INPUT_SCHEMA.json input.json package.json tsconfig.json ``` ### Limits - Amazon may still return CAPTCHA pages, even with residential proxies. - Reviews are best-effort because review pages are more aggressively throttled. - Sponsored and organic result cards are both considered product result cards. - The Actor currently supports `amazon.com` and `amazon.in`. ### Suggested Next Updates 1. Add more marketplaces such as `amazon.co.uk`, `amazon.de`, and `amazon.ca`. 2. Add variant extraction for color, size, and style options. 3. Add buy box and offer-listing extraction. 4. Add customer Q\&A extraction. 5. Add JSON-LD fallback extraction for pages where DOM selectors drift. ### Legal and Ethical Use Use this Actor for legitimate research, analytics, monitoring, and catalog enrichment. You are responsible for complying with Amazon's Conditions of Use and all applicable laws. Do not republish scraped content verbatim, and use conservative limits for recurring runs. ### License Apache-2.0 # Actor input Schema ## `searchKeyword` (type: `array`): One or more product search terms (e.g. 'echo dot', 'iphone 15 case'). Ignored if asinList or categoryUrl is provided. ## `asinList` (type: `array`): Direct product ASINs (10 characters). If non-empty, takes precedence over searchKeyword. ## `categoryUrl` (type: `string`): Full Amazon search/category URL or a single /dp/ URL. If set, takes precedence over searchKeyword. ## `marketplace` (type: `string`): Which Amazon site to scrape. Use 'amazon.com' (US) or 'amazon.in' (India). ## `maxProducts` (type: `integer`): Hard cap on products to scrape per keyword/ASIN list (1-500). ## `includeReviews` (type: `boolean`): Fetch a list of recent reviews for each product (extra requests, may slow the run). ## `maxReviewsPerProduct` (type: `integer`): Cap on reviews fetched per product when includeReviews is true (0-100). ## `trackPriceHistory` (type: `boolean`): Store a daily price snapshot for every scraped product in the dataset. ## `proxyConfig` (type: `object`): Apify proxy settings. RESIDENTIAL is strongly recommended for Amazon. ## `maxRequestsPerMinute` (type: `integer`): Crawl pacing. Lower = stealthier, higher = faster. Amazon tolerates 30/min on residential. ## Actor input object example ```json { "searchKeyword": [ "echo dot" ], "asinList": [ "B08N5WRWNW" ], "marketplace": "amazon.com", "maxProducts": 100, "includeReviews": false, "maxReviewsPerProduct": 10, "trackPriceHistory": true, "proxyConfig": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] }, "maxRequestsPerMinute": 30 } ``` # Actor output Schema ## `results` (type: `string`): Structured product data. Each item is a product with title, ASIN, price, rating, reviews, seller, images, specifications, and availability. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchKeyword": [ "echo dot" ], "asinList": [ "B08N5WRWNW" ] }; // Run the Actor and wait for it to finish const run = await client.actor("fascinating_lentil/amazon-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchKeyword": ["echo dot"], "asinList": ["B08N5WRWNW"], } # Run the Actor and wait for it to finish run = client.actor("fascinating_lentil/amazon-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchKeyword": [ "echo dot" ], "asinList": [ "B08N5WRWNW" ] }' | apify call fascinating_lentil/amazon-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=fascinating_lentil/amazon-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Amazon Scraper - Products, Prices & Reviews (.in & .com)", "description": "Scrape Amazon India (amazon.in) and Amazon US (amazon.com) for product data: titles, ASINs, prices, ratings, reviews, sellers, stock, images, specs, badges, and BSR. Search by keyword, ASIN list, or category URL. Residential proxies. Pay per result.", "version": "1.0", "x-build-id": "u1GgZi5whrfmoWmNL" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/fascinating_lentil~amazon-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-fascinating_lentil-amazon-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/fascinating_lentil~amazon-scraper/runs": { "post": { "operationId": "runs-sync-fascinating_lentil-amazon-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/fascinating_lentil~amazon-scraper/run-sync": { "post": { "operationId": "run-sync-fascinating_lentil-amazon-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "marketplace" ], "properties": { "searchKeyword": { "title": "Search keywords", "type": "array", "description": "One or more product search terms (e.g. 'echo dot', 'iphone 15 case'). Ignored if asinList or categoryUrl is provided.", "default": [ "echo dot" ], "items": { "type": "string" } }, "asinList": { "title": "ASIN list", "type": "array", "description": "Direct product ASINs (10 characters). If non-empty, takes precedence over searchKeyword.", "items": { "type": "string" } }, "categoryUrl": { "title": "Category or product URL", "type": "string", "description": "Full Amazon search/category URL or a single /dp/ URL. If set, takes precedence over searchKeyword." }, "marketplace": { "title": "Marketplace", "enum": [ "amazon.com", "amazon.in" ], "type": "string", "description": "Which Amazon site to scrape. Use 'amazon.com' (US) or 'amazon.in' (India).", "default": "amazon.com" }, "maxProducts": { "title": "Max products", "minimum": 1, "maximum": 500, "type": "integer", "description": "Hard cap on products to scrape per keyword/ASIN list (1-500).", "default": 100 }, "includeReviews": { "title": "Include reviews", "type": "boolean", "description": "Fetch a list of recent reviews for each product (extra requests, may slow the run).", "default": false }, "maxReviewsPerProduct": { "title": "Max reviews per product", "minimum": 0, "maximum": 100, "type": "integer", "description": "Cap on reviews fetched per product when includeReviews is true (0-100).", "default": 10 }, "trackPriceHistory": { "title": "Track price history", "type": "boolean", "description": "Store a daily price snapshot for every scraped product in the dataset.", "default": true }, "proxyConfig": { "title": "Proxy configuration", "type": "object", "description": "Apify proxy settings. RESIDENTIAL is strongly recommended for Amazon.", "default": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }, "maxRequestsPerMinute": { "title": "Requests per minute", "minimum": 5, "maximum": 30, "type": "integer", "description": "Crawl pacing. Lower = stealthier, higher = faster. Amazon tolerates 30/min on residential.", "default": 30 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```