# Ecommerce Price Scraper 1 (`fipper_ai/ecommerce-price-scraper-1`) Actor - **URL**: https://apify.com/fipper\_ai/ecommerce-price-scraper-1.md - **Developed by:** [Josh Baker](https://apify.com/fipper_ai) (community) - **Categories:** Automation, Developer tools, E-commerce - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Commerce Price Monitor Monitor public e-commerce pages for products, prices, availability, screenshots, and changes over time. This Actor is built for stores, agencies, resellers, SEO teams, and price-monitoring workflows where the user is allowed to crawl the target pages. ### What it does - Crawls store, category, collection, and product URLs - Renders pages with Playwright - Detects product pages by URL patterns and structured data - Extracts product title, price, currency, availability, brand, SKU, image, and page hash - Reads JSON-LD Product data when available - Falls back to common price and title selectors - Captures optional screenshots - Compares results against previous runs - Marks price, availability, and content changes - Saves structured records to the default Apify Dataset ### Best use cases - Price monitoring - Product availability monitoring - Competitor product tracking - Store catalog discovery - Client site audit snapshots - Reseller listing watchlists ### Input The Actor uses `INPUT_SCHEMA.json`. Important settings: - `start_urls`: store, category, collection, or product URLs - `max_pages`: total pages to visit - `max_products`: total product records to save - `max_depth`: link depth from the start URLs - `product_url_patterns`: URL fragments that identify product pages - `price_selectors`: optional CSS selectors for price fallback - `title_selectors`: optional CSS selectors for title fallback - `capture_screenshots`: save product screenshots - `detect_changes`: compare against previous run state ### Output Each product record includes: - `url` - `title` - `price.raw` - `price.amount` - `price.currency` - `availability` - `brand` - `sku` - `image` - `images` - `content_hash` - `previous_price` - `price_changed` - `availability_changed` - `content_changed` - `changed` - `screenshot_key` The final Dataset item is a summary with crawl totals. ### Monetization Recommended Apify pricing: - keep `apify-actor-start` - keep `apify-default-dataset-item` - price per product/result item This Actor has a clear paid use case: users pay to monitor products and price changes without building their own crawler. ### Responsible use Use this Actor only on websites you own, manage, or are allowed to crawl. It does not bypass CAPTCHA, paywalls, logins, or access controls. # Actor input Schema ## `start_urls` (type: `array`): Store home pages, collection pages, category pages, or direct product URLs. ## `max_pages` (type: `integer`): Hard limit for pages visited. ## `max_products` (type: `integer`): Hard limit for product records saved. ## `max_depth` (type: `integer`): How many link levels to follow from each start URL. ## `same_domain_only` (type: `boolean`): Only follow links on the same domain as the start URLs. ## `product_url_patterns` (type: `array`): URL fragments that usually identify product pages. ## `include_patterns` (type: `array`): Optional regex patterns URLs must match. ## `exclude_patterns` (type: `array`): Regex patterns to skip. ## `price_selectors` (type: `array`): Optional CSS selectors for price text. ## `title_selectors` (type: `array`): Optional CSS selectors for product title. ## `capture_screenshots` (type: `boolean`): Save product page screenshots to the key-value store. ## `detect_changes` (type: `boolean`): Compare price, availability, and content hash with the previous run. ## `snapshot_store_name` (type: `string`): Key-value store used to remember previous product state. ## `wait_ms` (type: `integer`): Extra wait before extracting product data. ## Actor input object example ```json { "start_urls": [ { "url": "https://example.com/products/sample-product" } ], "max_pages": 500, "max_products": 250, "max_depth": 4, "same_domain_only": true, "product_url_patterns": [ "/products/", "/product/", "/p/", "/item/", "/dp/" ], "include_patterns": [], "exclude_patterns": [ "/cart", "/checkout", "/account", "/login", "/logout", "/search", "sort=", "filter=" ], "price_selectors": [ "[itemprop='price']", ".price", ".product-price", "[class*='price']" ], "title_selectors": [ "h1", "[itemprop='name']", ".product-title" ], "capture_screenshots": true, "detect_changes": true, "snapshot_store_name": "commerce-price-monitor-snapshots", "wait_ms": 1000 } ```` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "start_urls": [ { "url": "https://example.com/products/sample-product" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("fipper_ai/ecommerce-price-scraper-1").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "start_urls": [{ "url": "https://example.com/products/sample-product" }] } # Run the Actor and wait for it to finish run = client.actor("fipper_ai/ecommerce-price-scraper-1").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "start_urls": [ { "url": "https://example.com/products/sample-product" } ] }' | apify call fipper_ai/ecommerce-price-scraper-1 --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=fipper_ai/ecommerce-price-scraper-1", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Ecommerce Price Scraper 1", "version": "0.0", "x-build-id": "3pYgjCmyAXKpd3Z9v" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/fipper_ai~ecommerce-price-scraper-1/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-fipper_ai-ecommerce-price-scraper-1", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/fipper_ai~ecommerce-price-scraper-1/runs": { "post": { "operationId": "runs-sync-fipper_ai-ecommerce-price-scraper-1", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/fipper_ai~ecommerce-price-scraper-1/run-sync": { "post": { "operationId": "run-sync-fipper_ai-ecommerce-price-scraper-1", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "start_urls" ], "properties": { "start_urls": { "title": "Store or category URLs", "type": "array", "description": "Store home pages, collection pages, category pages, or direct product URLs.", "items": { "type": "object", "properties": { "url": { "title": "URL", "type": "string", "description": "Store, category, collection, or product page URL to start crawling from.", "editor": "textfield", "pattern": "^https?://.+" } }, "required": [ "url" ], "additionalProperties": false } }, "max_pages": { "title": "Max pages", "minimum": 1, "type": "integer", "description": "Hard limit for pages visited.", "default": 500 }, "max_products": { "title": "Max products", "minimum": 1, "type": "integer", "description": "Hard limit for product records saved.", "default": 250 }, "max_depth": { "title": "Max crawl depth", "minimum": 0, "type": "integer", "description": "How many link levels to follow from each start URL.", "default": 4 }, "same_domain_only": { "title": "Same domain only", "type": "boolean", "description": "Only follow links on the same domain as the start URLs.", "default": true }, "product_url_patterns": { "title": "Product URL patterns", "type": "array", "description": "URL fragments that usually identify product pages.", "items": { "type": "string" }, "default": [ "/products/", "/product/", "/p/", "/item/", "/dp/" ] }, "include_patterns": { "title": "Include URL patterns", "type": "array", "description": "Optional regex patterns URLs must match.", "items": { "type": "string" }, "default": [] }, "exclude_patterns": { "title": "Exclude URL patterns", "type": "array", "description": "Regex patterns to skip.", "items": { "type": "string" }, "default": [ "/cart", "/checkout", "/account", "/login", "/logout", "/search", "sort=", "filter=" ] }, "price_selectors": { "title": "Price selectors", "type": "array", "description": "Optional CSS selectors for price text.", "items": { "type": "string" }, "default": [ "[itemprop='price']", ".price", ".product-price", "[class*='price']" ] }, "title_selectors": { "title": "Title selectors", "type": "array", "description": "Optional CSS selectors for product title.", "items": { "type": "string" }, "default": [ "h1", "[itemprop='name']", ".product-title" ] }, "capture_screenshots": { "title": "Capture screenshots", "type": "boolean", "description": "Save product page screenshots to the key-value store.", "default": true }, "detect_changes": { "title": "Detect changes", "type": "boolean", "description": "Compare price, availability, and content hash with the previous run.", "default": true }, "snapshot_store_name": { "title": "Snapshot store name", "type": "string", "description": "Key-value store used to remember previous product state.", "default": "commerce-price-monitor-snapshots" }, "wait_ms": { "title": "Wait after load", "minimum": 0, "type": "integer", "description": "Extra wait before extracting product data.", "default": 1000 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```