Sweep every URL the archive holds for a domain

Created by

Wild Origins

Actor

Wayback Machine Scraper

One run over a whole domain, subdomains included, returning every archived URL with its capture date and status. Export to CSV or JSON.

Try for free

Wayback Machine Scraperwildorigins/wayback-machine-scraper

Captured

Original URL

HTTP

Type

+3 fields

Input

URL:monzo.com

Earliest capture:2015

Latest capture:2026

What to match:domain

How many captures to keep:yearly

Maximum snapshots per URL:5000

Detect changes between captures:false

Retrieve the archived page:false

Output fields

Captured

Original URL

HTTP

Type

Content

Text chars

Snapshot

How it works

Sign up on Apify or log in

The Wayback Machine Scraper Actor is ready to run with the inputs already set for "Sweep every URL the archive holds for a domain". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Sweep every URL the archive holds for a domain" task

The Wayback Machine Scraper Actor will start running based on the input automatically. You can also change all the input fields, like URL, earliest capture, and more, to match your specific use case.

Receive the "Sweep every URL the archive holds for a domain" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as captured, original url, HTTP, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Sweep every URL the archive holds for a domain" task via API.