Wayback Machine Scraper — Archived Snapshots & Old URLs avatar

Wayback Machine Scraper — Archived Snapshots & Old URLs

Pricing

from $0.14 / 1,000 records

Go to Apify Store
Wayback Machine Scraper — Archived Snapshots & Old URLs

Wayback Machine Scraper — Archived Snapshots & Old URLs

Get Internet Archive (Wayback Machine) data for any URL or domain: full capture history with dates, status codes and archive links; every URL ever archived for a domain (find old pages for SEO and audits); or the closest snapshot to a date. Filter by date range, status and file type.

Pricing

from $0.14 / 1,000 records

Rating

0.0

(0)

Developer

Jefferson Valandro

Jefferson Valandro

Maintained by Community

Actor stats

0

Bookmarked

3

Total users

2

Monthly active users

12 days ago

Last modified

Features

Limited permissions

Share

Get Internet Archive (Wayback Machine) data for any URL or domain, from the official CDX API:

  • Capture history of each page: every snapshot (or one per day, month or year) with date, HTTP status, file type, size and the archive link, plus a raw-content link.
  • All archived URLs of a domain: every page the Wayback Machine has ever seen, with its first capture. Great for recovering old pages, redirects and backlinks after a migration.
  • Closest snapshot to a date for each URL.

Filter by date range, successful captures only and file type (HTML, PDF, images...).

Built for SEO and site migrations, competitor history research, content recovery, compliance and journalism.

Why this one

  • Three modes in one actor: history, all URLs of a domain, closest to a date.
  • Fast and cheap: thousands of records in seconds, no browser.
  • Raw links (id_ URLs) that return the original archived file without the Wayback toolbar.

Input

All archived HTML pages of a domain:

{
"urls": ["example.com"],
"mode": "urls",
"mimeType": "text/html",
"maxResultsPerUrl": 20000
}

One snapshot per year of a page:

{
"urls": ["nytimes.com/section/technology"],
"mode": "snapshots",
"onePer": "year"
}

Output

FieldDescription
input, urlrequested URL or domain, archived URL
timestamp, capturedAt / firstCapturedAtcapture date
statusCode, mimeType, sizeBytes, digestcapture details
archiveUrl, rawArchiveUrllinks to the archived page

Example output

One real item from a test run (long texts and lists shortened):

{
"type": "snapshot",
"url": "apify.com",
"timestamp": "20141216192636",
"capturedAt": "2014-12-16T19:26:36Z",
"statusCode": "200",
"archiveUrl": "http://web.archive.org/web/20141216192636/http://apify.com/",
"requestedDate": "20150101"
}

Feedback

Found a problem or need a field? Open an issue in the Issues tab: every issue is read and answered. If the actor helped you, a review on the Store helps a lot.

How much does it cost?

You pay only for results delivered, at a fixed price per item. Apify platform usage is included in that price, so there are no compute costs on top. Errors and items that couldn't be found are free.

What you getPriceExample
Record$0.0002 each1,000 records = $0.20

The Apify Free plan includes $5 of monthly credit, enough for about 25,000 records per month at no cost. You can also set a maximum spend per run.

On paid Apify plans it gets cheaper automatically: 10% off on Starter, 20% on Scale and 30% on Business.