Wayback Machine Scraper - Archived Snapshots & URL History
Pricing
from $1.00 / 1,000 results
Wayback Machine Scraper - Archived Snapshots & URL History
List Internet Archive Wayback Machine snapshots for any URL or whole domain: capture dates, archive links, status codes, MIME types, sizes, optional page text. Filter by date, status and type, collapse duplicates. Pay per snapshot.
Pricing
from $1.00 / 1,000 results
Rating
0.0
(0)
Developer
Bartosz Golis
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
17 hours ago
Last modified
Categories
Share
Wayback Machine Scraper
Get the full capture history of any page or website from the Internet Archive's Wayback Machine: every snapshot with date, archive link, HTTP status, MIME type and size — optionally with the page text. Uses the official CDX API with automatic paging, so even huge domains work.
Features
- Exact URL, URL prefix, whole host or whole domain incl. subdomains
- Collapse duplicates: only when content changed, one per day / month / year, or one per URL (= list of every archived URL of a site)
- Filter by date range, status code and MIME type (e.g. find every archived PDF on a domain)
- Optional page text of each snapshot
Example input
{"urls": ["competitor.com/pricing"],"collapse": "unique-content","from": "2023-01-01","fetchContent": true}
Example output
{"url": "https://competitor.com/pricing","capturedAt": "2024-03-02T10:11:12+00:00","archiveUrl": "https://web.archive.org/web/20240302101112/https://competitor.com/pricing","statusCode": 200,"mimeType": "text/html","lengthBytes": 18342,"contentText": "Pricing ..."}
Use cases
- Competitor monitoring: see how pricing and landing pages changed over time
- SEO & migrations: recover lists of old URLs of a site, find lost pages and PDFs
- Research, journalism & legal: prove what a page said on a given date
- Domain due diligence: check a domain's history before buying it
Pricing
Pay per result — you pay only for records saved to the dataset. Use Max results in total to cap the cost of a run.