🏛️ Wayback Machine Scraper — Archived Pages, URLs & Snapshots

Get the Internet Archive Wayback Machine (web.archive.org) history of any website in bulk: every snapshot with date, HTTP status and file type, all archived URLs of a domain (including pages that no longer exist), the capture closest to a date, and the title, description and text of old page versions exactly as they were.

$0.50 per 1,000 snapshots. Reading the archived page's content is optional ($0.002 per page). URLs with no captures and errors are free. No API key.

• ✅ Snapshot history of a URL, a path, a host or a whole domain with subdomains
• ✅ All archived URLs of a site — one row per page, with its first capture: find deleted pages, old blog posts and lost URLs to redirect
• ✅ Closest capture to any date — "what did this page look like on 2019-05-01?"
• ✅ Keep one capture per hour, day, month or year, or only when the content changed
• ✅ Date range, only successful captures (HTTP 200) and file type filters (HTML pages, PDFs, images…)
• ✅ Old page content: title, meta description, clean text, word count and number of links — optionally the raw HTML
• ✅ Links ready to open: the Wayback page (archiveUrl) and the original file without the Wayback toolbar (rawUrl)
• ✅ Bulk: many URLs per run, automatic paging through large histories, polite retries when the archive is busy

Who uses it

• SEO specialists — recover lost URLs and content after a migration, find old backlink targets, audit a site's history before buying an expired domain.
• Content teams — get back deleted articles and old versions of your own pages.
• Competitive research — see how competitors' pricing, homepage and messaging changed over the years.
• Lawyers, journalists & OSINT — dated evidence of what a page said and when.
• AI & data teams — historic web text for datasets and change analysis.

How to use it

1. Add URLs or domains (example.com, https://example.com/pricing, or a web.archive.org link).
2. Choose what to get: snapshot history, all archived URLs of a site, or the capture closest to a date.
3. Choose the match (exact URL, everything under a path, the host, or the whole domain) and how many captures to keep (one per day/month/year or on content change).
4. Optional: date range, file type, and download the archived page to get its title and text.
5. Run and export to CSV, Excel or JSON, or connect it to Google Sheets, Make, Zapier or n8n.

Examples

Monthly history of a pricing page, with its text:

{ "urls": ["https://example.com/pricing"], "mode": "snapshots", "collapse": "month", "fetchContent": "text" }

Every page ever archived on a domain (find lost URLs):

{ "urls": ["example.com"], "mode": "urls", "matchType": "domain", "mimeType": "text/html", "maxResultsPerUrl": 50000 }

Output example

{
  "type": "snapshot",
  "input": "apify.com",
  "url": "https://www.apify.com/",
  "timestamp": "20171010000347",
  "date": "2017-10-10T00:03:47Z",
  "archiveUrl": "https://web.archive.org/web/20171010000347/https://www.apify.com/",
  "rawUrl": "https://web.archive.org/web/20171010000347id_/https://www.apify.com/",
  "statusCode": 200,
  "mimeType": "text/html",
  "digest": "3JVHMXDJHHC33YHJT32EGULLRQHVSGI3",
  "lengthBytes": 9871,
  "title": "Apify - The web automation platform",
  "metaDescription": null,
  "text": "Apify - The web automation platform\nLibrary\nHelp\nPricing…",
  "wordCount": 1073
}

digest changes only when the archived content changed — handy to detect edits. Rows of type not_archived (free) tell you when nothing matched.

Pricing

• $0.0005 per snapshot or archived URL ($0.50 per 1,000)
• $0.002 per archived page downloaded (only when "Download the archived page" is on)

Not-archived URLs and errors are free. Higher Apify plans get an automatic discount, and you can set a maximum cost per run.

Tips

• Combine with Sitemap URL Extractor to compare today's pages with the archived ones and spot what disappeared.
• Check which old URLs still work with URL Status & Redirect Checker.

FAQ

Why are some captures missing? The Wayback Machine only has what its crawlers (and users) saved. Use matchType: prefix or domain to include URL variants, and remove the date range if you get nothing.

What does "only successful captures" do? It skips captures stored as redirects, 404s or server errors. Turn it off to see them too.

Is the text exactly what the page showed? It's the HTML the archive stored on that date, read without the Wayback toolbar. Pages that built their content with JavaScript may show little text.

How fast is it? Hundreds of snapshots per minute for histories; downloading page content depends on the archive's speed (a few pages per second). The Actor slows down automatically when the archive asks it to.

Is it legal? It uses the Internet Archive's public CDX and Availability APIs. The archived pages belong to their owners — respect copyright when you reuse them.

Something doesn't work? Open an issue in the Issues tab with the URL — we answer fast.