# Amazon Product & Review Scraper (`qianyii/amazon-product-scraper`) Actor Scrape Amazon products, reviews, and search results across multiple countries. Supports stealth mode with anti-detection and Apify Proxy integration. - **URL**: https://apify.com/qianyii/amazon-product-scraper.md - **Developed by:** [yy qq](https://apify.com/qianyii) (community) - **Categories:** E-commerce, Other - **Stats:** 2 total users, 1 monthly users, 25.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $10.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Amazon Product & Review Scraper Scrape Amazon **product details**, **customer reviews**, and **search results** across **9 country marketplaces** — with built-in stealth mode, anti-detection, and Apify Proxy integration. --- ### Features - **Product Details** — title, brand, price, rating, availability, bullet points, images, categories - **Customer Reviews** — full review text, rating, date, verified-purchase flag, sort & filter options - **Search Results** — keyword search with price/rating/Prime filters, up to 20 pages - **Multi-Country Price Comparison** — compare the same ASIN across US, UK, DE, JP, FR, CA, IT, ES, AU - **Anti-Detection** — randomised fingerprints, human-like behaviour simulation, CAPTCHA detection - **Apify Proxy Support** — residential proxies recommended for reliable scraping --- ### Supported Marketplaces | Code | Site | |------|------| | `us` | amazon.com | | `uk` | amazon.co.uk | | `de` | amazon.de | | `jp` | amazon.co.jp | | `fr` | amazon.fr | | `ca` | amazon.ca | | `it` | amazon.it | | `es` | amazon.es | | `au` | amazon.com.au | --- ### Input Configuration | Field | Type | Description | |-------|------|-------------| | `action` | `string` | **Required.** One of: `product`, `reviews`, `full`, `search`, `multi_country` | | `asins` | `string[]` | ASIN(s) to scrape (for `product`, `reviews`, `full`, `multi_country`) | | `keyword` | `string` | Search keyword (for `search` action) | | `country` | `string` | Amazon marketplace code, default `us` | | `countries` | `string` | Comma-separated country codes for `multi_country`, e.g. `us,uk,de` | | `maxReviews` | `integer` | Max reviews per product (default `100`) | | `sortReviews` | `string` | `recent` or `helpful` | | `filterReviews` | `string` | `all`, `positive`, `critical`, `5_star` … `1_star`, `verified` | | `maxPages` | `integer` | Max search result pages (default `3`) | | `sortSearch` | `string` | `relevance`, `price_low`, `price_high`, `avg_review`, `newest`, `best_sellers` | | `minPrice` | `number` | Minimum price filter (search) | | `maxPrice` | `number` | Maximum price filter (search) | | `primeOnly` | `boolean` | Only Prime-eligible products (search) | | `minRating` | `integer` | Minimum average star rating 1–4 (search) | | `excludeSponsored` | `boolean` | Skip sponsored results (search) | | `fetchDetails` | `boolean` | Fetch full product details after searching | | `detailCount` | `integer` | How many search results to fetch details for (default `20`) | | `proxyConfiguration` | `object` | Apify Proxy config — residential proxies recommended | --- ### Example Inputs #### Scrape product + reviews for 2 ASINs (US) ```json { "action": "full", "asins": ["B0BSHF7WHW", "B09V3KXJPB"], "country": "us", "maxReviews": 200 } ```` #### Search keyword with filters ```json { "action": "search", "keyword": "wireless earbuds", "country": "us", "maxPages": 5, "primeOnly": true, "minRating": 4, "fetchDetails": true, "detailCount": 30 } ``` #### Multi-country price comparison ```json { "action": "multi_country", "asins": ["B0BSHF7WHW"], "countries": "us,uk,de,jp,ca" } ``` *** ### Output Results are saved to the **Apify Dataset** and can be exported as **JSON**, **CSV**, or **Excel** from the Apify console. #### Product record fields `asin`, `title`, `brand`, `price`, `original_price`, `currency`, `rating`, `rating_count`, `availability`, `bullet_points`, `categories`, `images`, `url`, `country`, `scrape_time` #### Review record fields `asin`, `review_id`, `title`, `body`, `rating`, `date`, `verified_purchase`, `helpful_votes`, `reviewer_name` *** ### Proxy Recommendation Amazon actively blocks datacenter IPs. For best results: 1. In the **Proxy Configuration** input, enable **Apify Proxy** 2. Select the **RESIDENTIAL** proxy group 3. Set country to match your target Amazon marketplace *** ### Publishing to Apify Store — Step by Step #### Step 1: Install Apify CLI ```bash npm install -g apify-cli ``` Verify installation: ```bash apify --version ``` *** #### Step 2: Create an Apify Account Go to and register a free account. *** #### Step 3: Log in via CLI ```bash apify login ``` You will be prompted to enter your **API token**. Find it at: **Apify Console → Settings → Integrations → API token** *** #### Step 4: Test Locally Before Publishing ```bash ## Enter the project folder cd "d:\python313\pythonProject\接单\亚马逊商品爬取" ## Install Python dependencies pip install -r requirements.txt playwright install chromium ## Run the Actor locally (reads from storage/key_value_stores/default/INPUT.json) apify run ``` Create a test input file at `storage/key_value_stores/default/INPUT.json`: ```json { "action": "full", "asins": ["B0BSHF7WHW"], "country": "us", "maxReviews": 10 } ``` After running, check results in `storage/datasets/default/`. *** #### Step 5: Push (Upload) to Apify ```bash apify push ``` This command: 1. Reads `.actor/actor.json` for the Actor name and config 2. Builds a Docker image using your `Dockerfile` 3. Uploads everything to your Apify account The first push may take 2–5 minutes. *** #### Step 6: Test in Apify Console 1. Go to 2. Find your Actor `amazon-product-scraper` 3. Click **Start** → fill in the input form → **Save & Run** 4. Watch the live log and check **Dataset** tab for results *** #### Step 7: Set Pricing 1. Open your Actor → **Publication** tab 2. Toggle **Publish to Apify Store** 3. Set a **pricing model**: | Model | Description | Recommended for | |-------|-------------|-----------------| | **Free** | No charge, anyone can use | Build reputation first | | **Pay per result** | Charge per item scraped (e.g. $0.50 per 1000 results) | Volume scrapers | | **Rental** | Monthly subscription fee | Recurring users | > Tip: Start with **Free** or low pay-per-result to collect reviews, then raise the price after you get 5-star ratings. *** #### Step 8: Write a Good Store Listing Fill in these fields in the **Publication** tab: - **Title**: `Amazon Product & Review Scraper` - **Description**: Copy from this README or write SEO-friendly text with keywords like *amazon scraper*, *product data*, *review extractor* - **Categories**: E-commerce - **Tags**: `amazon`, `scraper`, `reviews`, `products`, `ecommerce` - **Screenshot**: Run the Actor once and screenshot the Dataset output *** #### Step 9: Maintain & Update After publishing, keep the Actor working: ```bash ## After making code changes, push an update apify push ## To run a specific version in the console, select it under "Build" tab ``` Monitor **Actor runs** in the console for errors. Amazon changes their HTML frequently — plan to update the parser every 2–4 months. *** ### Local Development (Without Apify) ```bash ## Install dependencies pip install -r requirements.txt playwright install chromium ## Run with the original CLI (no Apify SDK needed) python main.py full --asin B0BSHF7WHW --country us --max-reviews 100 python main.py search --keyword "wireless earbuds" --max-pages 3 python main.py multi --asin B0BSHF7WHW --countries us,uk,de,jp ``` # Actor input Schema ## `action` (type: `string`): What to scrape: product details, reviews, full (details+reviews), or search. ## `asins` (type: `array`): Amazon product ASIN(s) to scrape. Used for product, reviews, full, and multi\_country actions. ## `keyword` (type: `string`): Keyword to search on Amazon. Used only for the 'search' action. ## `country` (type: `string`): Which Amazon country site to scrape. ## `countries` (type: `string`): Comma-separated country codes for multi-country price comparison. E.g. us,uk,de,jp ## `maxReviews` (type: `integer`): Maximum number of reviews to scrape per ASIN. ## `sortReviews` (type: `string`): How to sort reviews. ## `filterReviews` (type: `string`): Filter reviews by star rating or type. ## `maxPages` (type: `integer`): Maximum number of search result pages to scrape. ## `sortSearch` (type: `string`): How to sort search results. ## `minPrice` (type: `number`): Minimum price filter for search results (leave empty for no filter). ## `maxPrice` (type: `number`): Maximum price filter for search results (leave empty for no filter). ## `primeOnly` (type: `boolean`): Only include Amazon Prime eligible products in search results. ## `minRating` (type: `integer`): Minimum average star rating filter for search results. Enter 1, 2, 3, or 4. ## `excludeSponsored` (type: `boolean`): Skip sponsored/ad products in search results. ## `fetchDetails` (type: `boolean`): After searching, also scrape full details for each product found. ## `detailCount` (type: `integer`): How many products from search results to fetch full details for. ## `proxyConfiguration` (type: `object`): Apify Proxy settings. Residential proxies are strongly recommended for Amazon. ## Actor input object example ```json { "action": "full", "asins": [ "B0BSHF7WHW", "B09V3KXJPB" ], "keyword": "wireless earbuds", "country": "us", "countries": "us,uk,de", "maxReviews": 100, "sortReviews": "recent", "filterReviews": "all", "maxPages": 3, "sortSearch": "relevance", "primeOnly": false, "excludeSponsored": false, "fetchDetails": false, "detailCount": 20, "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }; // Run the Actor and wait for it to finish const run = await client.actor("qianyii/amazon-product-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "proxyConfiguration": { "useApifyProxy": True, "apifyProxyGroups": ["RESIDENTIAL"], } } # Run the Actor and wait for it to finish run = client.actor("qianyii/amazon-product-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "proxyConfiguration": { "useApifyProxy": true, "apifyProxyGroups": [ "RESIDENTIAL" ] } }' | apify call qianyii/amazon-product-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=qianyii/amazon-product-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Amazon Product & Review Scraper", "description": "Scrape Amazon products, reviews, and search results across multiple countries. Supports stealth mode with anti-detection and Apify Proxy integration.", "version": "1.0", "x-build-id": "KBu1gfh1Sc1Jh0sLO" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/qianyii~amazon-product-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-qianyii-amazon-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/qianyii~amazon-product-scraper/runs": { "post": { "operationId": "runs-sync-qianyii-amazon-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/qianyii~amazon-product-scraper/run-sync": { "post": { "operationId": "run-sync-qianyii-amazon-product-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "action" ], "properties": { "action": { "title": "Action", "enum": [ "product", "reviews", "full", "search", "multi_country" ], "type": "string", "description": "What to scrape: product details, reviews, full (details+reviews), or search.", "default": "full" }, "asins": { "title": "ASINs", "type": "array", "description": "Amazon product ASIN(s) to scrape. Used for product, reviews, full, and multi_country actions.", "items": { "type": "string" } }, "keyword": { "title": "Search Keyword", "type": "string", "description": "Keyword to search on Amazon. Used only for the 'search' action." }, "country": { "title": "Amazon Marketplace", "enum": [ "us", "uk", "de", "jp", "fr", "ca", "it", "es", "au" ], "type": "string", "description": "Which Amazon country site to scrape.", "default": "us" }, "countries": { "title": "Countries (Multi-Country Mode)", "type": "string", "description": "Comma-separated country codes for multi-country price comparison. E.g. us,uk,de,jp", "default": "us,uk,de" }, "maxReviews": { "title": "Max Reviews per Product", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of reviews to scrape per ASIN.", "default": 100 }, "sortReviews": { "title": "Review Sort Order", "enum": [ "recent", "helpful" ], "type": "string", "description": "How to sort reviews.", "default": "recent" }, "filterReviews": { "title": "Review Filter", "enum": [ "all", "positive", "critical", "5_star", "4_star", "3_star", "2_star", "1_star", "verified" ], "type": "string", "description": "Filter reviews by star rating or type.", "default": "all" }, "maxPages": { "title": "Max Search Pages", "minimum": 1, "maximum": 20, "type": "integer", "description": "Maximum number of search result pages to scrape.", "default": 3 }, "sortSearch": { "title": "Search Sort Order", "enum": [ "relevance", "price_low", "price_high", "avg_review", "newest", "best_sellers" ], "type": "string", "description": "How to sort search results.", "default": "relevance" }, "minPrice": { "title": "Min Price Filter", "type": "number", "description": "Minimum price filter for search results (leave empty for no filter)." }, "maxPrice": { "title": "Max Price Filter", "type": "number", "description": "Maximum price filter for search results (leave empty for no filter)." }, "primeOnly": { "title": "Prime Only", "type": "boolean", "description": "Only include Amazon Prime eligible products in search results.", "default": false }, "minRating": { "title": "Min Star Rating (1-4)", "minimum": 1, "maximum": 4, "type": "integer", "description": "Minimum average star rating filter for search results. Enter 1, 2, 3, or 4." }, "excludeSponsored": { "title": "Exclude Sponsored Products", "type": "boolean", "description": "Skip sponsored/ad products in search results.", "default": false }, "fetchDetails": { "title": "Fetch Product Details After Search", "type": "boolean", "description": "After searching, also scrape full details for each product found.", "default": false }, "detailCount": { "title": "Number of Products to Fetch Details For", "minimum": 1, "maximum": 100, "type": "integer", "description": "How many products from search results to fetch full details for.", "default": 20 }, "proxyConfiguration": { "title": "Proxy Configuration", "type": "object", "description": "Apify Proxy settings. Residential proxies are strongly recommended for Amazon." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```