Wayback Machine Scraper: Archived Snapshots & URLs (CDX API) avatar

Wayback Machine Scraper: Archived Snapshots & URLs (CDX API)

Pricing

Pay per usage

Go to Apify Store
Wayback Machine Scraper: Archived Snapshots & URLs (CDX API)

Wayback Machine Scraper: Archived Snapshots & URLs (CDX API)

Wayback Machine scraper: list Internet Archive snapshots for any URL or domain: dates, status codes, MIME types, archive links. Find all archived URLs of a site, lost pages and content changes. Official CDX API, no login.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Tom Studio

Tom Studio

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

5 days ago

Last modified

Share

Wayback Machine Scraper - Archived Snapshots & URL Finder

List every Internet Archive (archive.org) Wayback Machine capture of a page, a folder or a whole domain: capture date, HTTP status, MIME type, content hash and a direct link to the archived page. Uses the official Wayback CDX API - no login, no proxy, no browser.

Use cases

  • SEO and site migrations: find old URLs that had traffic and need a redirect (matchType: host, collapse: urlkey).
  • Content history: see when a page changed (collapse: digest keeps only captures with new content).
  • Link reclamation and expired domains: check what a domain used to host.
  • Legal and research evidence: dated proof of what a page showed.
  • Competitor research: how pricing or landing pages evolved.

Input example

{
"urls": ["apify.com", "https://example.com/pricing"],
"matchType": "exact",
"collapse": "year",
"from": "2018",
"statusCodes": [200],
"maxSnapshotsPerUrl": 50
}
  • matchType: exact URL, prefix (everything under a path), host, or domain (with subdomains).
  • collapse: year, month, day, hour, urlkey (unique URLs) or digest (only when content changed).

Output sample

{
"input": "apify.com",
"timestamp": "20230115120000",
"capturedAt": "2023-01-15T12:00:00Z",
"originalUrl": "https://apify.com/",
"mimeType": "text/html",
"statusCode": "200",
"digest": "ABC123...",
"length": 15234,
"archiveUrl": "https://web.archive.org/web/20230115120000/https://apify.com/"
}

(values are illustrative; field names are exact)

Limits

  • It lists captures; it does not download the archived page content.
  • Default cap is 1,000 rows per input (maxSnapshotsPerUrl); raise it for big domains.
  • archive.org rate-limits heavy use; the Actor waits and retries politely. Very large domains can take a while.

More free tools by tomstudio