Wayback Machine Scraper: All Archived URLs & Snapshots
Pricing
from $0.15 / 1,000 result saveds
Wayback Machine Scraper: All Archived URLs & Snapshots
Get every URL the Wayback Machine (archive.org) ever captured for a domain, or the full snapshot history of a page: timestamp, status code, MIME type, size and direct archive links. Filters for status, file type and dates. Great for SEO, content recovery and recon.
Pricing
from $0.15 / 1,000 result saveds
Rating
0.0
(0)
Developer
veenkes
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
21 hours ago
Last modified
Categories
Features
Share
A Wayback Machine scraper for the archive.org CDX index. Get every URL ever archived for a domain (deduplicated) or the full snapshot history of a page, each with capture date, HTTP status, MIME type, size and a direct archive link.
Filter by status code, file type and date range. No API key.
Why use this Wayback Machine scraper?
- 🗂️ All unique URLs of a domain — find old pages, lost content, forgotten files and URL structures.
- 🕰️ Snapshot history of any page, deduplicated by content (only captures where the page changed).
- 🔎 Filters: HTTP 200 only, MIME types (HTML, PDF, images…), date range, subdomains.
- 🔗 Archive links in normal and raw (
id_) form for direct download. - 💸 $0.15–$0.30 per 1,000 results, far below other Wayback actors.
- 💸 From $0.15 per 1,000 results. No monthly rental.
Who is it for?
- SEO specialists: recover lost pages and backlinks after migrations, audit old URL structures.
- Content teams: find and restore deleted articles.
- Security researchers: map historical endpoints and files of a target (authorized testing only).
- Researchers and journalists: track how a page changed over time.
What data does it extract?
| Field | Example |
|---|---|
url | https://apify.com/agentx/tiktok-live-profile/output-schema |
timestamp | 2026-02-17T20:16:16Z |
statusCode, mimeType, length, digest | 200, text/html, 74011 |
archiveUrl, rawArchiveUrl | https://web.archive.org/web/20260217201616/https://apify.com/... |
How to use it
- Enter domains (URL mode) or page URLs (snapshot mode).
- Optionally set filters and max results.
- Click Start and export to CSV, Excel or JSON.
Run it from the API
You can start this Actor from any language with the official Apify API client. Replace YOUR_APIFY_TOKEN with a token from Apify Console > Integrations. Never put the token in a public repo.
Python
from apify_client import ApifyClientclient = ApifyClient("YOUR_APIFY_TOKEN")run = client.actor("veenkes/veenkes-wayback-urls").call(run_input={"targets": ["openai.com"],"mode": "urls","mimeTypes": ["text/html"],"maxResultsPerTarget": 5000})for item in client.dataset(run["defaultDatasetId"]).iterate_items():print(item)
JavaScript
import { ApifyClient } from 'apify-client';const client = new ApifyClient({ token: process.env.APIFY_TOKEN });const run = await client.actor('veenkes/veenkes-wayback-urls').call({"targets": ["openai.com"],"mode": "urls","mimeTypes": ["text/html"],"maxResultsPerTarget": 5000});const { items } = await client.dataset(run.defaultDatasetId).listItems();console.log(items);
Schedule the Actor, send results to a webhook, or connect it in Zapier, Make or n8n. Store page: https://apify.com/veenkes/veenkes-wayback-urls.
Use from AI agents (Apify MCP)
AI agents can run this Actor through the Apify MCP server. Connect Claude, Cursor or any MCP-compatible client to Apify, then ask the agent to call veenkes/veenkes-wayback-urls with an input like the example above. The agent discovers the tool from the Actor title and description.
How much does it cost?
| Apify plan tier | Price per 1,000 results |
|---|---|
| FREE | $0.30 |
| BRONZE | $0.25 |
| SILVER | $0.20 |
| GOLD and above | $0.15 |
There is also a $0.00005 start fee per run.
Input example
{"targets": ["openai.com/blog"],"mode": "urls","includeSubdomains": false,"onlyStatus200": true,"mimeTypes": ["text/html"],"fromDate": "2023-01-01","maxResultsPerTarget": 1000}
Output example
{"target": "apify.com","url": "https://apify.com/agentx/tiktok-live-profile/output-schema","timestamp": "2026-02-17T20:16:16Z","statusCode": 200,"mimeType": "text/html","length": 74011,"archiveUrl": "https://web.archive.org/web/20260217201616/https://apify.com/agentx/tiktok-live-profile/output-schema"}
The key-value store record SUMMARY lists every input with its status and the number of items saved.
Limitations
- The Wayback Machine index can be slow: a large domain may take a minute per few thousand URLs, and archive.org sometimes returns temporary errors (retried automatically).
- In URL mode each URL appears once with its first matching capture.
- Only what archive.org has captured is available.
Why this one?
URL and snapshot modes, practical filters and the lowest price per result, with automatic retries for archive.org hiccups.
FAQ
Do I need an archive.org account? No.
Why is a run slow? archive.org's index is slow for big domains; narrow with a path, file type or date range.
Is it legal? It reads archive.org's public index. Use it for lawful purposes.
Integrations
- Apify API — Python and JavaScript clients (examples above), plus a REST API.
- AI agents — run it via the Apify MCP server.
- Automation tools — Zapier, Make, n8n, or an Apify webhook when a run finishes.
- Export — download the dataset as JSON, CSV, Excel or XML, or load it from a scheduled run.
Open the Actor in Apify Store.
Not affiliated with or endorsed by the Internet Archive.