Wayback Machine Scraper: Archived Snapshots & URLs (CDX API)
Pricing
Pay per usage
Wayback Machine Scraper: Archived Snapshots & URLs (CDX API)
Wayback Machine scraper: list Internet Archive snapshots for any URL or domain: dates, status codes, MIME types, archive links. Find all archived URLs of a site, lost pages and content changes. Official CDX API, no login.
Pricing
Pay per usage
Rating
0.0
(0)
Developer
Tom Studio
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
5 days ago
Last modified
Categories
Share
Wayback Machine Scraper - Archived Snapshots & URL Finder
List every Internet Archive (archive.org) Wayback Machine capture of a page, a folder or a whole domain: capture date, HTTP status, MIME type, content hash and a direct link to the archived page. Uses the official Wayback CDX API - no login, no proxy, no browser.
Use cases
- SEO and site migrations: find old URLs that had traffic and need a redirect (
matchType: host,collapse: urlkey). - Content history: see when a page changed (
collapse: digestkeeps only captures with new content). - Link reclamation and expired domains: check what a domain used to host.
- Legal and research evidence: dated proof of what a page showed.
- Competitor research: how pricing or landing pages evolved.
Input example
{"urls": ["apify.com", "https://example.com/pricing"],"matchType": "exact","collapse": "year","from": "2018","statusCodes": [200],"maxSnapshotsPerUrl": 50}
matchType:exactURL,prefix(everything under a path),host, ordomain(with subdomains).collapse:year,month,day,hour,urlkey(unique URLs) ordigest(only when content changed).
Output sample
{"input": "apify.com","timestamp": "20230115120000","capturedAt": "2023-01-15T12:00:00Z","originalUrl": "https://apify.com/","mimeType": "text/html","statusCode": "200","digest": "ABC123...","length": 15234,"archiveUrl": "https://web.archive.org/web/20230115120000/https://apify.com/"}
(values are illustrative; field names are exact)
Limits
- It lists captures; it does not download the archived page content.
- Default cap is 1,000 rows per input (
maxSnapshotsPerUrl); raise it for big domains. - archive.org rate-limits heavy use; the Actor waits and retries politely. Very large domains can take a while.
More free tools by tomstudio
- ATS Jobs Scraper (Workday, Greenhouse, Lever, Ashby...)
- TED Tenders Monitor (EU & Swiss public procurement)
- SEC EDGAR Filings Monitor
- Domain Availability & RDAP Bulk Checker
- App Store Reviews Scraper
- Hacker News Search & Comments
- Wayback Machine Snapshots
- RSS & Atom Feed Reader
- YouTube Transcript Scraper