# Ecommerce Product Page Scraper (`fetch_cat/ecommerce-product-page-scraper`) Actor Extract product title, price, availability, SKU, UPC, images, ratings, and metadata from public ecommerce product URLs. - **URL**: https://apify.com/fetch\_cat/ecommerce-product-page-scraper.md - **Developed by:** [Hanna Nosova](https://apify.com/fetch_cat) (community) - **Categories:** E-commerce, Automation, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $0.20 / 1,000 product page processeds This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Ecommerce Product Page Scraper Extract structured product snapshots from public ecommerce product page URLs. Paste product links and get normalized rows with title, price, availability, identifiers, images, ratings, breadcrumbs, metadata provenance, and per-URL errors when a page is blocked or missing. Use this Actor for price monitoring, competitor analysis, product catalog enrichment, SEO audits, marketplace research, and automated checks where you already have product URLs. ### Who is this for? - Ecommerce analysts comparing public prices and stock status across stores. - Price-monitoring operators who already maintain lists of product URLs. - SEO and content teams auditing product metadata, descriptions, images, and breadcrumbs. - Data teams enriching internal catalogs with public product page snapshots. - Dropshipping and marketplace researchers checking visible identifiers, availability, and price text. ### Use cases - Monitor public prices and availability for a known set of competitor products. - Enrich a product database with titles, descriptions, images, and identifiers. - Audit product pages for missing structured metadata or empty descriptions. - Check stale product links and capture 404/error rows without failing the whole run. - Feed normalized product data into spreadsheets, dashboards, alerts, or agents. ### Example input ```json { "urls": [ "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html", "https://books.toscrape.com/catalogue/tipping-the-velvet_999/index.html" ], "maxItems": 2, "includeRawMetadata": false } ```` ### Example output ```json { "url": "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html", "finalUrl": "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html", "statusCode": 200, "title": "A Light in the Attic", "price": "£51.77", "currency": null, "availability": "In stock (22 available)", "sku": null, "upc": "a897fe39b1053632", "brand": null, "description": "It's hard to imagine a world without A Light in the Attic...", "ratingValue": null, "reviewCount": null, "images": [], "breadcrumbs": ["Home", "Books", "Poetry", "A Light in the Attic"], "structuredDataTypes": [], "sourceMethod": "dom", "error": null, "fetchedAt": "2026-07-12T15:44:45.332Z" } ``` ### What data can you extract? | Field | Description | | --- | --- | | `url` | Original product URL from your input. | | `finalUrl` | Final URL after redirects. | | `statusCode` | HTTP status code returned by the product page. | | `title` | Product title/name when visible. | | `price` | Price text or structured price value. | | `currency` | Currency from structured product metadata or product meta tags. | | `availability` | Stock/availability text or structured availability value. | | `sku` | SKU when published on the page. | | `upc` | UPC/GTIN identifier when published on the page. | | `brand` | Product brand when available. | | `description` | Product description or page meta description. | | `ratingValue` | Aggregate rating value when available. | | `reviewCount` | Aggregate review/rating count when available. | | `images` | Product image URLs found in structured data, social meta tags, or product image markup. | | `breadcrumbs` | Category/breadcrumb trail when visible. | | `structuredDataTypes` | Structured data types detected on the page. | | `sourceMethod` | Main extraction source: `jsonLd`, `meta`, `dom`, `fallback`, or `error`. | | `error` | Per-URL error message for missing, blocked, or failed pages. | | `fetchedAt` | ISO timestamp when the URL was processed. | | `rawMetadata` | Optional parsed metadata snippets when `includeRawMetadata` is enabled. | ### Input configuration | Setting | JSON key | Use it for | Default | | --- | --- | --- | --- | | Product page URLs | `urls` | Direct public product detail page URLs to process. | Required | | Maximum product pages | `maxItems` | Cap processed URLs and control spend. | `10` | | Include raw metadata | `includeRawMetadata` | Debug custom mappings or inspect structured metadata. | `false` | | Render JavaScript | `renderJavascript` | Reserved compatibility option; current version is HTTP-first. | `false` | | Request timeout seconds | `requestTimeoutSecs` | Adjust timeout for slow stores. | `30` | | Proxy configuration | `proxyConfiguration` | Optional Apify proxy settings for stores that block your network. | Empty | ### Verified public example tasks These Apify Store tasks use small, QA-verified inputs and can be opened or cloned directly: - [Compare Two Ecommerce Product Pages](https://apify.com/fetch_cat/ecommerce-product-page-scraper/tasks/compare-two-ecommerce-product-pages) — verified run `IJSfh1c4gKOy5hi3g` produced 2 dataset items. - [Inspect Raw Ecommerce Product Metadata](https://apify.com/fetch_cat/ecommerce-product-page-scraper/tasks/inspect-raw-ecommerce-product-metadata) — verified run `lmnNYqpXdMQo2xf4O` produced 1 dataset item. - [Scrape Public Ecommerce Product Page](https://apify.com/fetch_cat/ecommerce-product-page-scraper/tasks/scrape-public-ecommerce-product-page) — verified run `m91hC4XTogFMV4fPN` produced 1 dataset item. ### Input recipes - **Smoke test**: Run the default Books to Scrape URL with `maxItems: 1`. - **Price monitoring sample**: Paste 10-50 direct product URLs from public store pages and schedule the Actor daily or weekly. - **Catalog enrichment**: Export product URLs from your catalog, run the Actor, then join results by `url` or `finalUrl`. - **Error audit**: Include known old URLs and check `statusCode` plus `error` for missing or redirected product pages. ### Pricing | Event | Price | Charged when | | --- | --- | --- | | Run start | `$0.005` per run | Once when the Actor starts. | | Item processed | Bronze `$0.00033834` per saved product row, with tier discounts for higher usage | Each URL result saved to the dataset, including graceful error rows. | Per-item Store tiers: Free `$0.00038909`, Bronze `$0.00033834`, Silver `$0.00026391`, Gold `$0.00020301`, Platinum `$0.00013534`, Diamond `$0.000094736`. Start with a small run to confirm output completeness for your target stores before processing large URL lists. ### Tips for best results - Use direct product detail URLs, not category, search, cart, or checkout URLs. - Product fields vary by store. Empty fields mean the page did not expose that data clearly. - For blocked stores, try Apify Proxy settings and keep batches small while testing. - Use `sourceMethod` to understand whether data came from structured metadata, meta tags, or page content. - Keep `includeRawMetadata` disabled unless you need debugging details; it can make rows larger. ### Limits and caveats - This Actor extracts public page data only. It does not log in, solve CAPTCHAs, add items to cart, or access account-specific prices. - Some ecommerce sites block automated traffic or require client-side rendering. Such URLs may return partial data or an error row. - Universal product extraction is best-effort. Store-specific scrapers may be better for high-volume extraction from a single marketplace. ### API usage Node.js: ```js import { ApifyClient } from "apify-client"; const client = new ApifyClient({ token: process.env.APIFY_TOKEN }); const run = await client.actor("fetch_cat/ecommerce-product-page-scraper").call({ urls: ["https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"], maxItems: 1 }); console.log(run.defaultDatasetId); ``` Python: ```python from apify_client import ApifyClient client = ApifyClient("YOUR_APIFY_TOKEN") run = client.actor("fetch_cat/ecommerce-product-page-scraper").call(run_input={ "urls": ["https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"], "maxItems": 1, }) print(run["defaultDatasetId"]) ``` cURL: ```bash curl -X POST "https://api.apify.com/v2/acts/fetch_cat~ecommerce-product-page-scraper/runs?token=YOUR_APIFY_TOKEN" \ -H "Content-Type: application/json" \ -d '{"urls":["https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"],"maxItems":1}' ``` ### MCP and AI agents Use this Actor from MCP-compatible tools through the official Apify MCP Server. ```bash claude mcp add --transport http apify "https://mcp.apify.com?tools=fetch_cat/ecommerce-product-page-scraper" ``` ```json { "mcpServers": { "apify": { "url": "https://mcp.apify.com?tools=fetch_cat/ecommerce-product-page-scraper" } } } ``` Example prompt: "Run Ecommerce Product Page Scraper for these three product URLs and summarize price, stock status, and missing fields." ### Related actors - [Shopify Products Scraper](https://apify.com/fetch_cat/shopify-products-scraper) - [Website Content Crawler Lite](https://apify.com/fetch_cat/website-content-crawler-lite) - [Website Change Monitor](https://apify.com/fetch_cat/website-change-monitor) ### FAQ #### Can I export results? Yes. Apify datasets support JSON, CSV, Excel, XML, RSS, and API access. #### Why are some fields empty? Stores expose different metadata. The Actor leaves unavailable fields empty instead of guessing. #### Does it work for login-only or cart prices? No. It only processes public product pages visible without private credentials. #### What happens if a URL is invalid or blocked? The Actor saves an error row with `statusCode` and/or `error` so one bad URL does not fail the whole run. ### Support Open an issue from the Actor page if a run fails or output looks wrong. Include the run ID or run URL, input JSON, expected output, actual output, and one reproducible public URL. ### Changelog - 2026-07-16 - Feature: Added ready-to-run example tasks on the Apify Store - 2026-07-16 - Feature: Launched ecommerce product page scraper for public Apify Store users. # Actor input Schema ## `urls` (type: `array`): Public ecommerce product page URLs to extract. Add direct product detail pages, not category or search pages. ## `maxItems` (type: `integer`): Maximum number of URLs to process from the input list. ## `includeRawMetadata` (type: `boolean`): Include parsed structured metadata snippets for debugging and custom mapping. ## `renderJavascript` (type: `boolean`): Reserved compatibility option for pages that need rendering. Current version remains HTTP-first and returns graceful errors for blocked pages. ## `requestTimeoutSecs` (type: `integer`): How long to wait for each product page request. ## `proxyConfiguration` (type: `object`): Optional Apify proxy settings for stores that block your current network. Leave empty for public test pages. ## Actor input object example ```json { "urls": [ "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html" ], "maxItems": 10, "includeRawMetadata": false, "renderJavascript": false, "requestTimeoutSecs": 30 } ``` # Actor output Schema ## `products` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html" ] }; // Run the Actor and wait for it to finish const run = await client.actor("fetch_cat/ecommerce-product-page-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": ["https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html"] } # Run the Actor and wait for it to finish run = client.actor("fetch_cat/ecommerce-product-page-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html" ] }' | apify call fetch_cat/ecommerce-product-page-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=fetch_cat/ecommerce-product-page-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Ecommerce Product Page Scraper", "description": "Extract product title, price, availability, SKU, UPC, images, ratings, and metadata from public ecommerce product URLs.", "version": "0.1", "x-build-id": "tHRLrsMkRkKAz073Y" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/fetch_cat~ecommerce-product-page-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-fetch_cat-ecommerce-product-page-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/fetch_cat~ecommerce-product-page-scraper/runs": { "post": { "operationId": "runs-sync-fetch_cat-ecommerce-product-page-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/fetch_cat~ecommerce-product-page-scraper/run-sync": { "post": { "operationId": "run-sync-fetch_cat-ecommerce-product-page-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "urls" ], "properties": { "urls": { "title": "Product page URLs", "type": "array", "description": "Public ecommerce product page URLs to extract. Add direct product detail pages, not category or search pages.", "items": { "type": "string" } }, "maxItems": { "title": "Maximum product pages", "minimum": 1, "maximum": 10000, "type": "integer", "description": "Maximum number of URLs to process from the input list.", "default": 10 }, "includeRawMetadata": { "title": "Include raw metadata", "type": "boolean", "description": "Include parsed structured metadata snippets for debugging and custom mapping.", "default": false }, "renderJavascript": { "title": "Render JavaScript", "type": "boolean", "description": "Reserved compatibility option for pages that need rendering. Current version remains HTTP-first and returns graceful errors for blocked pages.", "default": false }, "requestTimeoutSecs": { "title": "Request timeout seconds", "minimum": 5, "maximum": 120, "type": "integer", "description": "How long to wait for each product page request.", "default": 30 }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Optional Apify proxy settings for stores that block your current network. Leave empty for public test pages." } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```