# Any Website Detail Page Scraper (`mrscrapercom/mrscraper-pdp`) Actor Unblock pages and scrape detail page from any websites. It is stealth, reliable, and scalable. Every action uses the mrscraper.com engine to extract structured product data. - **URL**: https://apify.com/mrscrapercom/mrscraper-pdp.md - **Developed by:** [MrScraper](https://apify.com/mrscrapercom) (community) - **Categories:** AI, E-commerce, Real estate - **Stats:** 3 total users, 2 monthly users, 83.3% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $3.00 / 1,000 standard requests This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## MrScraper PDP - Scrape Any Detail Page! Unblock pages and scrape detail pages from any websites. It is stealth, reliable, and scalable. Every action uses the [MrScraper](https://mrscraper.com) engine to extract structured data from various types of content. ### Features - **Universal Detail Page Scraping** - Extract structured data from articles, products, hotels, jobs, properties, restaurants, social media profiles, tours/attractions, and more - **Pay-per-event Pricing** - Only pay for what you use with transparent event-based pricing - **Flexible Data Fetching** - Choose between HTTP requests or browser rendering - **Proxy Support** - Residential & mobile proxy support with geo-targeting for accessing geo-restricted content - **Network Traffic Capture** - Option to listen to network requests during browser rendering - **Multiple Output Formats** - Get data as JSON, plus optional HTML and Markdown output ### How It Works 1. The Actor receives input with URLs to scrape, content category, and data fetching preferences 2. It validates the input and charges based on selected options (pay-per-event model) 3. MrScraper engine scrapes the provided URLs based on your configuration 4. Returns structured data in JSON format (with optional HTML and Markdown) ### Input Parameters #### Required Parameters | Parameter | Type | Required | Description | |-----------|------|----------|-------------| | `urls` | array | Yes | List of URLs to scrape (product pages, hotel listings, restaurant pages, etc.) | | `category` | string | Yes | Select the type of content being scraped (see Available Categories below) | #### Data Fetching Method | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | `browser_rendering_enabled` | boolean | `false` | Enable browser rendering for JavaScript-heavy pages (adds costs) | | `browser_rendering_listen_network` | boolean | `false` | Capture network requests/responses during page loading - adds costs, but results may be more accurate. Only applicable if browser rendering is enabled | | `browser_rendering_wait_for_selector` | string | `""` | CSS selector to wait for before extracting data (e.g., `#some_container`, `.container`). Only applicable if browser rendering is enabled | #### Proxy Configuration | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | `proxy_use_proxy` | boolean | `true` | Routes requests through residential & mobile IPs to bypass anti-bot protection. Recommended for heavily protected sites | | `proxy_proxy_country` | string | `""` | Route the request through a proxy in a specific country to access geo-restricted content. If not set, the request will be routed through a random country. Only applicable if residential & mobile proxy is enabled | | `proxy_bypass_proxy` | boolean | `true` | Block images, fonts, and stylesheets from loading. Speeds up scraping and reduces bandwidth usage. Only applicable if residential & mobile proxy is enabled | #### Output Options | Parameter | Type | Default | Description | |-----------|------|---------|-------------| | `html` | boolean | `false` | Include raw HTML in the output | | `markdown` | boolean | `false` | Include markdown version in the output | #### Available Categories - `article` - Article pages - `post` - Social Media Post - `hotel` - Hotel listings - `job posting` - Job postings - `product` - Product pages (default) - `property` - Real estate/property listings - `restaurant` - Restaurant pages - `social media profile` - Social media profiles - `tour/attraction` - Tours and attractions ### Output The Actor stores extracted data in the dataset. The output structure depends on the category selected and typically includes: ```json { "url": "https://example.com/product/123", "category": "product", "title": "Product Name", "description": "Product description...", "price": "$99.99", "images": ["https://example.com/image1.jpg"], "html": "", "markdown": "" } ```` ### Pricing Events This Actor uses pay-per-event pricing. Events are charged as follows: | Event | Description | |-------|-------------| | `standard-request` | Charged per URL processed | | `browser-rendering` | Charged per URL when browser rendering is enabled | | `network-listening` | Charged per URL when network listening is enabled (requires browser) | | `time-based-cost` | Charged based on time taken to scrape (per minute) | | `bandwidth-cost` | Charged based on bandwidth used (per MB) | | `ai-token-cost` | Charged based on AI token usage during extraction | ### Contact Us For enterprise solutions, custom integrations, or high-volume scraping needs, please contact MrScraper directly at or [book a call here](https://cal.com/cahyo-mrscraper/30min?user=cahyo-mrscraper). We offer tailored solutions to meet your specific business requirements. # Actor input Schema ## `urls` (type: `array`): List of URLs to scrape (product pages, hotel listings, restaurant pages, etc.) ## `category` (type: `string`): Select the type of content being scraped ## `browser_rendering_enabled` (type: `boolean`): Enable browser rendering for JavaScript-heavy pages (add costs) ## `browser_rendering_listen_network` (type: `boolean`): Capture network requests/responses during page loading - add costs, but results may be more accurate. Only applicable if browser rendering is enabled. ## `browser_rendering_wait_for_selector` (type: `string`): CSS selector to wait for before extracting data (e.g. #some\_container, .container). Only applicable if browser rendering is enabled. ## `proxy_use_proxy` (type: `boolean`): Routes requests through residential & mobile IPs to bypass anti-bot protection. Recommended for heavily protected sites. ## `proxy_proxy_country` (type: `string`): Route the request through a proxy in a specific country to access geo-restricted content. If not set, the request will be routed through a random country. Only applicable if residential & mobile proxy is enabled. ## `proxy_bypass_proxy` (type: `boolean`): Block images, fonts, and stylesheets from loading. Speeds up scraping and reduces bandwidth usage. Only applicable if residential & mobile proxy is enabled. ## `output_html` (type: `boolean`): Include raw HTML in the output ## `output_markdown` (type: `boolean`): Include markdown version in the output ## Actor input object example ```json { "urls": [ { "url": "https://www.ebay.com/itm/236604718789" } ], "category": "product", "browser_rendering_enabled": false, "browser_rendering_listen_network": false, "browser_rendering_wait_for_selector": "", "proxy_use_proxy": true, "proxy_proxy_country": "", "proxy_bypass_proxy": true, "output_html": false, "output_markdown": false } ``` # Actor output Schema ## `result` (type: `string`): Response from MrScraper API # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "urls": [ { "url": "https://www.ebay.com/itm/236604718789" } ] }; // Run the Actor and wait for it to finish const run = await client.actor("mrscrapercom/mrscraper-pdp").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "urls": [{ "url": "https://www.ebay.com/itm/236604718789" }] } # Run the Actor and wait for it to finish run = client.actor("mrscrapercom/mrscraper-pdp").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "urls": [ { "url": "https://www.ebay.com/itm/236604718789" } ] }' | apify call mrscrapercom/mrscraper-pdp --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=mrscrapercom/mrscraper-pdp", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Any Website Detail Page Scraper", "description": "Unblock pages and scrape detail page from any websites. It is stealth, reliable, and scalable. Every action uses the mrscraper.com engine to extract structured product data.", "version": "0.1", "x-build-id": "T2sS7QXVm0PAFo69C" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/mrscrapercom~mrscraper-pdp/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-mrscrapercom-mrscraper-pdp", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/mrscrapercom~mrscraper-pdp/runs": { "post": { "operationId": "runs-sync-mrscrapercom-mrscraper-pdp", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/mrscrapercom~mrscraper-pdp/run-sync": { "post": { "operationId": "run-sync-mrscrapercom-mrscraper-pdp", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "urls", "category" ], "properties": { "urls": { "title": "URLs", "minItems": 1, "type": "array", "description": "List of URLs to scrape (product pages, hotel listings, restaurant pages, etc.)", "items": { "type": "object", "required": [ "url" ], "properties": { "url": { "type": "string", "title": "URL of a web page", "format": "uri" } } } }, "category": { "title": "Category", "enum": [ "article", "post", "hotel", "job posting", "product", "property", "restaurant", "social media profile", "tour/attraction" ], "type": "string", "description": "Select the type of content being scraped", "default": "product" }, "browser_rendering_enabled": { "title": "Enable Browser Rendering", "type": "boolean", "description": "Enable browser rendering for JavaScript-heavy pages (add costs)", "default": false }, "browser_rendering_listen_network": { "title": "Listen to Network Requests", "type": "boolean", "description": "Capture network requests/responses during page loading - add costs, but results may be more accurate. Only applicable if browser rendering is enabled.", "default": false }, "browser_rendering_wait_for_selector": { "title": "Wait for Selector", "type": "string", "description": "CSS selector to wait for before extracting data (e.g. #some_container, .container). Only applicable if browser rendering is enabled.", "default": "" }, "proxy_use_proxy": { "title": "Residential & Mobile Proxy", "type": "boolean", "description": "Routes requests through residential & mobile IPs to bypass anti-bot protection. Recommended for heavily protected sites.", "default": true }, "proxy_proxy_country": { "title": "Geo Targeting", "enum": [ "", "af", "al", "dz", "as", "ad", "ao", "ai", "ag", "ar", "am", "aw", "au", "at", "az", "bs", "bh", "bd", "bb", "by", "be", "bz", "bj", "bm", "bt", "bo", "bq", "ba", "bw", "br", "io", "bn", "bg", "bf", "bi", "cv", "kh", "cm", "ca", "ky", "td", "cl", "cn", "co", "km", "cd", "cg", "ck", "cr", "hr", "cu", "cw", "cy", "cz", "ci", "dk", "dj", "dm", "do", "ec", "eg", "sv", "ee", "sz", "et", "fo", "fj", "fi", "fr", "pf", "ga", "gm", "ge", "de", "gh", "gi", "gr", "gl", "gd", "gp", "gu", "gt", "gg", "gn", "gy", "ht", "va", "hn", "hk", "hu", "is", "in", "id", "ir", "iq", "ie", "im", "il", "it", "jm", "jp", "je", "jo", "kz", "ke", "ki", "kr", "kw", "kg", "la", "lv", "lb", "lr", "ly", "lt", "lu", "mo", "mg", "mw", "my", "mv", "ml", "mt", "mr", "mu", "yt", "mx", "fm", "md", "mc", "mn", "me", "ma", "mz", "mm", "na", "np", "nl", "nc", "nz", "ni", "ne", "ng", "mp", "no", "om", "pk", "pw", "ps", "pa", "pg", "py", "pe", "ph", "pl", "pt", "pr", "qa", "mk", "ro", "ru", "rw", "re", "kn", "lc", "mf", "pm", "vc", "ws", "sm", "st", "sa", "sn", "rs", "sc", "sl", "sg", "sx", "sk", "si", "so", "za", "ss", "es", "lk", "sd", "sr", "se", "ch", "sy", "tw", "tj", "tz", "th", "tl", "tg", "tk", "to", "tt", "tn", "tr", "tm", "tc", "tv", "ug", "ua", "ae", "gb", "us", "uy", "uz", "ve", "vn", "vg", "vi", "ye", "zm", "zw" ], "type": "string", "description": "Route the request through a proxy in a specific country to access geo-restricted content. If not set, the request will be routed through a random country. Only applicable if residential & mobile proxy is enabled.", "default": "" }, "proxy_bypass_proxy": { "title": "Block Resources", "type": "boolean", "description": "Block images, fonts, and stylesheets from loading. Speeds up scraping and reduces bandwidth usage. Only applicable if residential & mobile proxy is enabled.", "default": true }, "output_html": { "title": "Also return HTML", "type": "boolean", "description": "Include raw HTML in the output", "default": false }, "output_markdown": { "title": "Also return markdown", "type": "boolean", "description": "Include markdown version in the output", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```