Wayback Machine Scraper - Archived Snapshots & URL History avatar

Wayback Machine Scraper - Archived Snapshots & URL History

Pricing

from $1.00 / 1,000 results

Go to Apify Store
Wayback Machine Scraper - Archived Snapshots & URL History

Wayback Machine Scraper - Archived Snapshots & URL History

List Internet Archive Wayback Machine snapshots for any URL or whole domain: capture dates, archive links, status codes, MIME types, sizes, optional page text. Filter by date, status and type, collapse duplicates. Pay per snapshot.

Pricing

from $1.00 / 1,000 results

Rating

0.0

(0)

Developer

Bartosz Golis

Bartosz Golis

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

17 hours ago

Last modified

Categories

Share

Wayback Machine Scraper

Get the full capture history of any page or website from the Internet Archive's Wayback Machine: every snapshot with date, archive link, HTTP status, MIME type and size — optionally with the page text. Uses the official CDX API with automatic paging, so even huge domains work.

Features

  • Exact URL, URL prefix, whole host or whole domain incl. subdomains
  • Collapse duplicates: only when content changed, one per day / month / year, or one per URL (= list of every archived URL of a site)
  • Filter by date range, status code and MIME type (e.g. find every archived PDF on a domain)
  • Optional page text of each snapshot

Example input

{
"urls": ["competitor.com/pricing"],
"collapse": "unique-content",
"from": "2023-01-01",
"fetchContent": true
}

Example output

{
"url": "https://competitor.com/pricing",
"capturedAt": "2024-03-02T10:11:12+00:00",
"archiveUrl": "https://web.archive.org/web/20240302101112/https://competitor.com/pricing",
"statusCode": 200,
"mimeType": "text/html",
"lengthBytes": 18342,
"contentText": "Pricing ..."
}

Use cases

  • Competitor monitoring: see how pricing and landing pages changed over time
  • SEO & migrations: recover lists of old URLs of a site, find lost pages and PDFs
  • Research, journalism & legal: prove what a page said on a given date
  • Domain due diligence: check a domain's history before buying it

Pricing

Pay per result — you pay only for records saved to the dataset. Use Max results in total to cap the cost of a run.