# Copy Website (`hgservices/copy-website`) Actor Copy any public website into a browsable snapshot. Saves HTML and optional screenshots up to a chosen crawl depth. - **URL**: https://apify.com/hgservices/copy-website.md - **Developed by:** [Harish Garg](https://apify.com/hgservices) (community) - **Categories:** AI, Agents, MCP servers - **Stats:** 1 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Copy Website | Save Pages as HTML & Screenshots Copy any public website into a browsable snapshot. Works on modern JavaScript-heavy sites. No setup required. --- ### 🚀 What this Actor does * Copy any public website in minutes * Works on JavaScript-heavy sites (React, Vue, etc.) * Choose how deep to crawl — you stay in control * Save pages as HTML for offline use * Optionally capture screenshots for each page This Actor is designed to be the **simplest way to copy a website** without dealing with complex scraping setups. --- ### 📦 What you get For each page: * Full HTML snapshot * Page URL and metadata * Crawl depth information * Optional screenshot (for visual reference) All results are stored in a dataset and can be exported as JSON, CSV, or downloaded for further use. --- ### 🧠 How it works 1. Start from a URL 2. Crawl links within the same website 3. Capture each page (HTML + optional screenshot) 4. Continue up to your defined depth --- ### ⚔️ How this is different Unlike traditional web scrapers, this Actor focuses on: > **Capturing full page snapshots — not just extracting text** That means: * You get complete pages, not partial data * Better for offline browsing, archiving, and backups * No need to configure complex extraction rules --- ### 💡 Use cases * Archive a website before it changes * Download documentation for offline use * Save blog content for research * Backup public websites * Analyze site structure --- ### 💰 Pricing Simple and predictable: > You only pay for successfully saved pages. * 1 page saved = 1 billable event * Failed or blocked pages are not counted This makes costs easy to estimate and control. --- ### ⚙️ Example input ```json { "startUrl": "https://example.com", "maxDepth": 2 } ```` *** ### ⚠️ Limitations Works best for: - Blogs - Documentation sites - Marketing websites May struggle with: - Login-required sites - Highly protected websites (e.g., strong anti-bot systems) - Extremely dynamic or infinite-scroll apps *** ### 🧩 Tips for best results - Start with a low depth (1–2) to test - Increase depth gradually - Avoid very large sites unless needed - Use screenshots for debugging tricky pages *** ### 🏁 Summary > The simplest way to copy any public website. No complex scraping configs. No confusing pricing. Just give a URL, set depth, and get your website snapshot. *** # Actor input Schema ## `startUrl` (type: `string`): The website to copy. Crawling starts here and stays on the same domain. ## `maxDepth` (type: `integer`): How many link hops away from the start URL to follow. 0 = only the start page, 1 = the start page plus its direct links, and so on. ## `maxRequests` (type: `integer`): Safety limit on how many pages the crawl will attempt in total. Prevents runaway crawls on large sites. ## `captureScreenshots` (type: `boolean`): Save a full-page screenshot of every saved page. Useful for visual reference but slower. ## Actor input object example ```json { "startUrl": "https://apify.com", "maxDepth": 1, "maxRequests": 10, "captureScreenshots": false } ``` # Actor output Schema ## `results` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "startUrl": "https://apify.com", "maxDepth": 1, "maxRequests": 10 }; // Run the Actor and wait for it to finish const run = await client.actor("hgservices/copy-website").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "startUrl": "https://apify.com", "maxDepth": 1, "maxRequests": 10, } # Run the Actor and wait for it to finish run = client.actor("hgservices/copy-website").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "startUrl": "https://apify.com", "maxDepth": 1, "maxRequests": 10 }' | apify call hgservices/copy-website --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=hgservices/copy-website", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Copy Website", "description": "Copy any public website into a browsable snapshot. Saves HTML and optional screenshots up to a chosen crawl depth.", "version": "0.1", "x-build-id": "Nm1u3A6cfx5mFl2OH" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/hgservices~copy-website/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-hgservices-copy-website", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/hgservices~copy-website/runs": { "post": { "operationId": "runs-sync-hgservices-copy-website", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/hgservices~copy-website/run-sync": { "post": { "operationId": "run-sync-hgservices-copy-website", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrl" ], "properties": { "startUrl": { "title": "Start URL", "pattern": "^https?://", "type": "string", "description": "The website to copy. Crawling starts here and stays on the same domain." }, "maxDepth": { "title": "Max depth", "minimum": 0, "maximum": 10, "type": "integer", "description": "How many link hops away from the start URL to follow. 0 = only the start page, 1 = the start page plus its direct links, and so on.", "default": 1 }, "maxRequests": { "title": "Max pages", "minimum": 1, "maximum": 10000, "type": "integer", "description": "Safety limit on how many pages the crawl will attempt in total. Prevents runaway crawls on large sites.", "default": 10 }, "captureScreenshots": { "title": "Capture screenshots", "type": "boolean", "description": "Save a full-page screenshot of every saved page. Useful for visual reference but slower.", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```