# Wayback Machine CDX URL List Scraper (`parseforge/wayback-cdx-scraper`) Actor Pull every archived URL the Internet Archive has captured for any domain or URL prefix. Get timestamps, MIME types, status codes, content digests, and direct snapshot links. Filter by date range, status, MIME, and uniqueness. Export to JSON, CSV, or Excel for SEO recovery and competitive research. - **URL**: https://apify.com/parseforge/wayback-cdx-scraper.md - **Developed by:** [ParseForge](https://apify.com/parseforge) (community) - **Categories:** Developer tools, Automation, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $8.25 / 1,000 items This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ![ParseForge Banner](https://github.com/ParseForge/apify-assets/blob/ad35ccc13ddd068b9d6cba33f323962e39aed5b2/banner.jpg?raw=true) ## ๐Ÿ•ฐ๏ธ Wayback Machine CDX Scraper > ๐Ÿš€ **Export every archived URL the Internet Archive holds for any domain or URL prefix.** Filter by date range, status, MIME, and uniqueness. No API key, no registration. > ๐Ÿ•’ **Last updated:** 2026-05-01 ยท **๐Ÿ“Š 10 fields** per record ยท **๐Ÿ•ฐ๏ธ archives back to 1996** ยท **๐ŸŒ billions of snapshots** ยท **๐Ÿ”“ free public CDX index** The **Wayback Machine CDX Scraper** queries the public Internet Archive CDX index for a domain or URL prefix and returns every snapshot the Wayback Machine has on file. Each record includes the URL key, raw timestamp, ISO timestamp, original URL, MIME type, HTTP status, content digest, byte length, and a direct snapshot link you can open in any browser. The Wayback Machine has been running since 1996 and now holds more than 800 billion web pages. It is the canonical historical record of the public web, used by lawyers for evidence, by SEO teams for content recovery, and by journalists for accountability work. This Actor handles CDX query syntax, pagination, and filters server-side so you skip writing the parser yourself. | ๐ŸŽฏ Target Audience | ๐Ÿ’ก Primary Use Cases | |---|---| | SEO teams, web archivists, OSINT researchers, journalists, security analysts, legal teams | Lost-content recovery, redirect audits, brand history, competitor evolution, link reclamation, evidence collection | --- ### ๐Ÿ“‹ What the Wayback Machine CDX Scraper does Five filtering workflows in a single run: - ๐ŸŒ **Full domain export.** Submit a domain or URL prefix and pull every snapshot the archive holds. - ๐Ÿ“ **Match-type control.** `exact` for one URL, `prefix` for a path tree, `host` for one hostname, `domain` for the host plus subdomains. - ๐Ÿ“… **Date range.** `from` and `to` timestamps in YYYYMMDD format restrict to a specific window. - ๐ŸŒ **MIME and status filter.** Restrict to `text/html` or `200`-only snapshots when auditing a redirect map. - ๐Ÿ” **Unique URLs.** `uniqueOnly` collapses by URL key so you get one row per distinct URL instead of one per capture. Each row reports the CDX URL key, original URL, raw timestamp, ISO timestamp, MIME type, HTTP status, content digest, byte length, and a direct snapshot link in `web.archive.org/web/{ts}/{url}` form. > ๐Ÿ’ก **Why it matters:** the CDX index is the cheapest historical web record available. When a competitor pivots, when a regulator demands evidence of a marketing claim, or when an SEO team needs to recover a deleted blog, the Wayback Machine is usually the only public source. Building your own pipeline against the CDX endpoint means handling pagination tokens and timestamp formats; this Actor handles all of that. --- ### ๐ŸŽฌ Full Demo _๐Ÿšง Coming soon: a 3-minute walkthrough showing how to go from sign-up to a downloaded dataset._ --- ### โš™๏ธ Input
InputTypeDefaultBehavior
maxItemsinteger10Snapshots to return. Free plan caps at 10, paid plan at 1,000,000.
urlOrDomainstring"apify.com"Domain or URL prefix to look up.
matchTypestring"domain"exact, prefix, host, or domain.
fromDatestringemptyEarliest timestamp. Examples: 2020, 202001, 20200115.
toDatestringemptyLatest timestamp.
statusCodestringemptyHTTP status filter, e.g. 200.
mimeTypestringemptyMIME type filter, e.g. text/html.
collapsestringemptyCDX collapse field, e.g. urlkey.
uniqueOnlybooleanfalseShortcut for collapse=urlkey.
**Example: every HTML snapshot of apify.com homepage.** ```json { "maxItems": 100, "urlOrDomain": "apify.com", "matchType": "exact", "mimeType": "text/html", "statusCode": "200" } ```` **Example: every unique URL ever captured under a competitor blog.** ```json { "maxItems": 1000, "urlOrDomain": "example.com/blog", "matchType": "prefix", "uniqueOnly": true, "fromDate": "2020" } ``` > โš ๏ธ **Good to Know:** very broad queries on busy domains can return millions of rows. Always set `maxItems` and ideally a date window. The CDX endpoint accepts multi-million-row responses but they take minutes to download. *** ### ๐Ÿ“Š Output Each snapshot record contains **10 fields**. Download as CSV, Excel, JSON, or XML. #### ๐Ÿงพ Schema | Field | Type | Example | |---|---|---| | ๐Ÿ”‘ `urlkey` | string | `"com,apify)/"` | | โฑ๏ธ `timestamp` | string | `"20070531101538"` | | ๐Ÿ”— `original` | string | `"http://www.apify.com:80/"` | | ๐Ÿ“„ `mimetype` | string | null | `"text/html"` | | โœ… `statusCode` | integer | null | `200` | | ๐Ÿ” `digest` | string | null | `"EE6FCHP3MKBC3EV5D5Q4WQJNZNVUTNU6"` | | ๐Ÿ“ฆ `length` | integer | null | `1013` | | ๐ŸŒ `snapshotUrl` | string | `"https://web.archive.org/web/20070531101538/..."` | | ๐Ÿ“… `timestampIso` | ISO 8601 | null | `"2007-05-31T10:15:38.000Z"` | | ๐Ÿ•’ `scrapedAt` | ISO 8601 | `"2026-05-01T00:47:14.231Z"` | #### ๐Ÿ“ฆ Sample records
๐Ÿ•ฐ๏ธ First-ever snapshot of apify.com from May 2007 ```json { "urlkey": "com,apify)/", "timestamp": "20070531101538", "original": "http://www.apify.com:80/", "mimetype": "text/html", "statusCode": 200, "digest": "EE6FCHP3MKBC3EV5D5Q4WQJNZNVUTNU6", "length": 1013, "snapshotUrl": "https://web.archive.org/web/20070531101538/http://www.apify.com:80/", "timestampIso": "2007-05-31T10:15:38.000Z", "scrapedAt": "2026-05-01T00:47:14.231Z" } ```
๐Ÿ” Redirect snapshot returning HTTP 301 ```json { "urlkey": "com,apify)/legacy-pricing", "timestamp": "20210914082041", "original": "https://apify.com/legacy-pricing", "mimetype": "text/html", "statusCode": 301, "digest": "RQXMCT3ULKLP3NVCWS6VLOTLSDJTPIXR", "length": 422, "snapshotUrl": "https://web.archive.org/web/20210914082041/https://apify.com/legacy-pricing", "timestampIso": "2021-09-14T08:20:41.000Z", "scrapedAt": "2026-05-01T00:47:14.890Z" } ```
๐Ÿ“ฆ Asset snapshot of a CSS file ```json { "urlkey": "com,apify)/static/css/main.css", "timestamp": "20240412091134", "original": "https://apify.com/static/css/main.css", "mimetype": "text/css", "statusCode": 200, "digest": "PLHQR4N7ABCD1234XYZ5LPTH6789ABCDE", "length": 24588, "snapshotUrl": "https://web.archive.org/web/20240412091134/https://apify.com/static/css/main.css", "timestampIso": "2024-04-12T09:11:34.000Z", "scrapedAt": "2026-05-01T00:47:15.402Z" } ```
*** ### โœจ Why choose this Actor | | Capability | |---|---| | ๐Ÿ†“ | **Free public source.** Reads the Internet Archive CDX endpoint, no auth needed. | | ๐Ÿ•ฐ๏ธ | **Decades of history.** Archive starts 1996, with continuous coverage of major sites. | | ๐Ÿ“ | **Match-type control.** Exact URL, prefix tree, host, or full domain in a single input. | | ๐Ÿ“… | **Flexible date windows.** Year, month, day precision via `fromDate` and `toDate`. | | ๐Ÿ” | **Unique-URL collapse.** One row per URL key when you only need a content map. | | ๐ŸŒ | **Direct snapshot links.** Each row carries a ready-to-open Wayback URL. | | ๐Ÿ›ก๏ธ | **Pagination handled.** CDX returns paged responses; the Actor walks them all. | > ๐Ÿ“Š The Internet Archive reports more than 800 billion web pages indexed across the Wayback Machine. *** ### ๐Ÿ“ˆ How it compares to alternatives | Approach | Cost | Coverage | Refresh | Filters | Setup | |---|---|---|---|---|---| | Manual CDX queries | Free | Full | Live | Manual | Engineer hours | | Paid web archive APIs | $$$ subscription | Partial | Daily | Built-in | Account setup | | Static archive dumps | Free | Snapshot only | Stale | None | Self-host parser | | **โญ Wayback Machine CDX Scraper** *(this Actor)* | Pay-per-event | Full | Live | Match type, dates, status, MIME | None | Same CDX endpoint the Internet Archive itself exposes, wrapped in a clean filter UI. *** ### ๐Ÿš€ How to use 1. ๐Ÿ†“ **Create a free Apify account.** [Sign up here](https://console.apify.com/sign-up?fpr=vmoqkp) and get $5 in free credit. 2. ๐Ÿ” **Open the Actor.** Search for "Wayback Machine CDX" in the Apify Store. 3. โš™๏ธ **Set your inputs.** Pick the URL or domain, match type, and any filters. 4. โ–ถ๏ธ **Click Start.** A 100-snapshot run typically completes in 10 to 40 seconds. 5. ๐Ÿ“ฅ **Download.** Export as CSV, Excel, JSON, or XML. > โฑ๏ธ Total time from sign-up to first dataset: under five minutes. *** ### ๐Ÿ’ผ Business use cases
#### ๐Ÿ“ˆ SEO & content recovery - Recover deleted blog posts and product pages - Audit historical redirect chains for migration QA - Reclaim broken backlinks pointing to dead URLs - Pull old metadata for content rebuild projects #### ๐Ÿ›ก๏ธ Brand & competitive - Trace how a competitor's positioning evolved - Document past marketing claims for legal review - Detect domain ownership changes via WHOIS plus archive - Monitor design and copy iterations across years
#### โš–๏ธ Legal & compliance - Collect evidence-grade snapshots of past pages - Preserve disputed content before it disappears - Track regulatory disclosure timelines on public sites - Verify warranty or pricing terms at a specific date #### ๐Ÿ“ฐ Journalism & OSINT - Investigate deleted statements from public figures - Pull historical versions of government pages - Track edits to disputed Wikipedia-adjacent sources - Cite stable timestamped URLs in reporting
*** ### ๐ŸŒŸ Beyond business use cases Data like this powers more than commercial workflows. The same structured records support research, education, civic projects, and personal initiatives.
#### ๐ŸŽ“ Research and academia - Empirical datasets for papers, thesis work, and coursework - Longitudinal studies tracking changes across snapshots - Reproducible research with cited, versioned data pulls - Classroom exercises on data analysis and ethical scraping #### ๐ŸŽจ Personal and creative - Side projects, portfolio demos, and indie app launches - Data visualizations, dashboards, and infographics - Content research for bloggers, YouTubers, and podcasters - Hobbyist collections and personal trackers
#### ๐Ÿค Non-profit and civic - Transparency reporting and accountability projects - Advocacy campaigns backed by public-interest data - Community-run databases for local issues - Investigative journalism on public records #### ๐Ÿงช Experimentation - Prototype AI and machine-learning pipelines with real data - Validate product-market hypotheses before engineering spend - Train small domain-specific models on niche corpora - Test dashboard concepts with live input
*** ### ๐Ÿ”Œ Automating Wayback Machine CDX Scraper Run this Actor on a schedule, from your codebase, or inside another tool: - **Node.js** SDK: see [Apify JavaScript client](https://docs.apify.com/api/client/js/) for programmatic runs. - **Python** SDK: see [Apify Python client](https://docs.apify.com/api/client/python/) for the same flow in Python. - **HTTP API**: see [Apify API docs](https://docs.apify.com/api/v2) for raw REST integration. Schedule daily, weekly, or monthly runs from the Apify Console. Pipe results into Google Sheets, S3, BigQuery, or your own webhook with the built-in [integrations](https://docs.apify.com/platform/integrations). *** ### โ“ Frequently Asked Questions
๐Ÿ“… How far back does the data go? The Internet Archive started crawling in 1996. Many large sites have continuous coverage from then on; smaller sites were added later as the archive expanded.
๐Ÿ” What is the difference between match types? `exact` matches one URL only. `prefix` matches a URL plus everything beneath it. `host` matches one hostname. `domain` matches the host plus all subdomains.
๐Ÿ” What does uniqueOnly do? It collapses results by URL key, so you get one row per distinct URL instead of one row per capture. Useful when building a content map of a domain.
๐ŸŒ Can I get the actual page content? Each row includes a `snapshotUrl` you can open in a browser to view the captured page. Pulling the rendered HTML in bulk is a separate workflow.
๐Ÿ“ฆ How many snapshots can I pull at once? Free plan caps at 10. Paid plans go up to 1,000,000. Very broad queries on busy sites can return millions of rows; always set a date window for those.
๐Ÿ”  How do I format the URL? Pass the bare domain (`apify.com`) or a URL prefix (`example.com/blog`). The CDX endpoint normalizes and splits the URL into a key automatically.
๐Ÿ“… What date format does the API expect? YYYYMMDD or any prefix of it. `2020` matches everything in 2020. `202001` matches January 2020. `20200115` matches a specific day.
๐Ÿ’ผ Can I use this for commercial work? Yes. The CDX index is part of the Internet Archive's public API surface. Always cite the Internet Archive when republishing snapshots.
๐Ÿ’ณ Do I need a paid Apify plan? The free plan returns up to 10 snapshots per run. Paid plans return up to 1,000,000.
โš ๏ธ What if a run returns no rows? Most often the URL has not been crawled or is filtered out by status/MIME. Try with no status filter and a wider date window. [Open a contact form](https://tally.so/r/BzdKgA) and include the run URL if the issue persists.
๐Ÿ” How fresh is the data? Live. Each run hits the Internet Archive CDX endpoint at run time.
โš–๏ธ Is this legal? Yes. The Internet Archive publishes the CDX index for exactly this kind of programmatic access. The Actor respects the published rate limits.
*** ### ๐Ÿ”Œ Integrate with any app - [**Make**](https://apify.com/integrations/make) - drop run results into 1,800+ apps. - [**Zapier**](https://apify.com/integrations/zapier) - trigger automations off completed runs. - [**Slack**](https://apify.com/integrations/slack) - post run summaries to a channel. - [**Google Sheets**](https://apify.com/integrations/google-sheets) - sync each run into a spreadsheet. - [**Webhooks**](https://docs.apify.com/platform/integrations/webhooks) - notify your own services on run finish. - [**Airbyte**](https://apify.com/integrations/airbyte) - load runs into Snowflake, BigQuery, or Postgres. *** ### ๐Ÿ”— Recommended Actors - [**๐ŸŒ Common Crawl Index Scraper**](https://apify.com/parseforge/common-crawl-index-scraper) - second-largest public web archive, complementary coverage. - [**๐Ÿ…ฑ๏ธ Bing Search Scraper**](https://apify.com/parseforge/bing-search-scraper) - find current rank for the URLs you recover. - [**๐Ÿฆ† DuckDuckGo Search Scraper**](https://apify.com/parseforge/duckduckgo-search-scraper) - alternative SERP signal alongside Wayback history. - [**๐Ÿ“š Wikipedia Pageviews Scraper**](https://apify.com/parseforge/wikipedia-pageviews-scraper) - cross-reference brand mentions over time. - [**๐Ÿ™ GitHub Trending Repos Scraper**](https://apify.com/parseforge/github-trending-scraper) - track adjacent developer-attention shifts. > ๐Ÿ’ก **Pro Tip:** browse the complete [ParseForge collection](https://apify.com/parseforge) for more pre-built scrapers and data tools. *** **๐Ÿ†˜ Need Help?** [**Open our contact form**](https://tally.so/r/BzdKgA) and we'll route the question to the right person. *** > Internet Archive and Wayback Machine are trademarks of Internet Archive, a 501(c)(3) non-profit. This Actor is not affiliated with or endorsed by Internet Archive. It uses only the public CDX index endpoint and respects all published rate limits. # Actor input Schema ## `maxItems` (type: `integer`): Free users: Limited to 10 items (preview). Paid users: Optional, max 1,000,000. ## `url` (type: `string`): Domain or URL to look up in the Wayback Machine. Examples: `apify.com`, `example.com/blog`, `https://news.ycombinator.com`. ## `matchType` (type: `string`): How to match the URL: `exact` (exact URL only), `prefix` (URL plus all subpaths), `host` (entire host), or `domain` (host plus all subdomains). ## `fromDate` (type: `string`): Earliest snapshot timestamp. Examples: `2020`, `202001`, `20200115`. Leave empty for the entire archive. ## `toDate` (type: `string`): Latest snapshot timestamp. Same format as From date. ## `statusCode` (type: `string`): Restrict to a specific status code, e.g. `200`, `404`, `301`. Leave empty for all status codes. ## `mimeType` (type: `string`): Filter by MIME type, e.g. `text/html`, `application/pdf`, `image/jpeg`. Leave empty for all. ## `collapse` (type: `string`): Collapse adjacent duplicate snapshots. Common values: `digest` (dedupe by content hash), `urlkey` (one entry per URL), `timestamp:6` (one per month). ## `uniqueOnly` (type: `boolean`): When enabled, returns only the first snapshot per unique URL. ## Actor input object example ```json { "maxItems": 10, "url": "apify.com", "matchType": "domain", "uniqueOnly": false } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "maxItems": 10, "url": "apify.com", "matchType": "domain" }; // Run the Actor and wait for it to finish const run = await client.actor("parseforge/wayback-cdx-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "maxItems": 10, "url": "apify.com", "matchType": "domain", } # Run the Actor and wait for it to finish run = client.actor("parseforge/wayback-cdx-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("๐Ÿ’พ Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # ๐Ÿ“š Want to learn more ๐Ÿ“–? Go to โ†’ https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "maxItems": 10, "url": "apify.com", "matchType": "domain" }' | apify call parseforge/wayback-cdx-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=parseforge/wayback-cdx-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Wayback Machine CDX URL List Scraper", "description": "Pull every archived URL the Internet Archive has captured for any domain or URL prefix. Get timestamps, MIME types, status codes, content digests, and direct snapshot links. Filter by date range, status, MIME, and uniqueness. Export to JSON, CSV, or Excel for SEO recovery and competitive research.", "version": "1.0", "x-build-id": "dIUyCK0JfunQd6BwO" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/parseforge~wayback-cdx-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-parseforge-wayback-cdx-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/parseforge~wayback-cdx-scraper/runs": { "post": { "operationId": "runs-sync-parseforge-wayback-cdx-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/parseforge~wayback-cdx-scraper/run-sync": { "post": { "operationId": "run-sync-parseforge-wayback-cdx-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "maxItems": { "title": "Max Items", "minimum": 1, "maximum": 1000000, "type": "integer", "description": "Free users: Limited to 10 items (preview). Paid users: Optional, max 1,000,000." }, "url": { "title": "URL or domain", "type": "string", "description": "Domain or URL to look up in the Wayback Machine. Examples: `apify.com`, `example.com/blog`, `https://news.ycombinator.com`." }, "matchType": { "title": "Match type", "enum": [ "exact", "prefix", "host", "domain" ], "type": "string", "description": "How to match the URL: `exact` (exact URL only), `prefix` (URL plus all subpaths), `host` (entire host), or `domain` (host plus all subdomains).", "default": "domain" }, "fromDate": { "title": "From date (YYYYMMDD)", "type": "string", "description": "Earliest snapshot timestamp. Examples: `2020`, `202001`, `20200115`. Leave empty for the entire archive." }, "toDate": { "title": "To date (YYYYMMDD)", "type": "string", "description": "Latest snapshot timestamp. Same format as From date." }, "statusCode": { "title": "HTTP status code", "type": "string", "description": "Restrict to a specific status code, e.g. `200`, `404`, `301`. Leave empty for all status codes." }, "mimeType": { "title": "MIME type", "type": "string", "description": "Filter by MIME type, e.g. `text/html`, `application/pdf`, `image/jpeg`. Leave empty for all." }, "collapse": { "title": "Collapse duplicates", "type": "string", "description": "Collapse adjacent duplicate snapshots. Common values: `digest` (dedupe by content hash), `urlkey` (one entry per URL), `timestamp:6` (one per month)." }, "uniqueOnly": { "title": "Unique URLs only", "type": "boolean", "description": "When enabled, returns only the first snapshot per unique URL.", "default": false } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```