Pricing

from $8.25 / 1,000 items

Try for free

Go to Apify Store

Wayback Machine CDX Snapshot List Scraper

Try for free

Queries the Wayback Machine CDX index for a URL or domain and returns each snapshot as a flat row with timestamp, original URL, snapshot URL, HTTP status, MIME type, and content digest. Filter by date, status, and MIME type server-side.

Pricing

from $8.25 / 1,000 items

Rating

0.0

(0)

Developer

ParseForge

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

Developer tools

Automation

Other

URL or domain

urlOrDomain

Required

Target URL, host, or domain to look up in the Wayback Machine CDX index. Examples: example.com, https://example.com/path, sub.example.com

Type:string

Maximum snapshots

maxItems

Optional

How many snapshots to collect per run.

Type:integer

Minimum:1

Maximum:1000000

Output mode

outputMode

Optional

One row per snapshot returns the full capture list: the same URL appears once per archived capture. One row per unique URL returns each distinct URL once, with how many times it was captured and its first and last capture timestamps.

Type:string

Default:unique-urls

Options:

unique-urlssnapshots

Match type

matchType

Optional

How urlOrDomain is matched against the CDX index. exact = identical URL, prefix = same path prefix, host = same host only, domain = host + all subdomains.

Type:string

Default:domain

Options:

exactprefixhostdomain

From (timestamp)

from

Optional

Inclusive lower bound on capture timestamp. Format: yyyy[MM[dd[HH[mm[ss]]]]] (e.g. 2020, 202001, 20200115, 20200115120000).

Type:string

To (timestamp)

Optional

Inclusive upper bound on capture timestamp. Same format as From.

Type:string

MIME type filter

mimeFilter

Optional

Regex applied to the mimetype field. Prefix with ! to invert. Examples: text/html, ^image/, !text/html

Type:string

HTTP status filter

statusFilter

Optional

Regex applied to the statuscode field. Prefill 200 keeps only captures that resolved; clear it to also get redirects and 404s. Prefix with ! to invert. Examples: 200, ^2[0-9]{2}$, !404

Type:string

Collapse adjacent duplicates

collapse

Optional

Remove adjacent duplicate captures based on a CDX field. Format: field or field:N (first N characters). Common values: timestamp:8 (one capture per day), digest (drop content-identical captures), urlkey.

Type:string

Wayback Machine Scraper — Archived Snapshots

hipersoft/wayback-machine-scraper

List every Internet Archive (Wayback Machine) snapshot of a URL or whole domain: timestamp, snapshot URL, status code, MIME type and content digest. Filter by date, status and dedupe. For SEO, OSINT and historical research. No setup.

hiper soft

Wayback Cdx Scraper

fortuitous_pirate/wayback-cdx-scraper

Scrape the Internet Archive Wayback Machine CDX index: find all archived snapshots of any URL with timestamps, HTTP status codes, and MIME types.

Fortuitous Pirate

Wayback Machine Snapshot History Scraper

automation-lab/wayback-machine-snapshot-history-scraper

Export Internet Archive Wayback Machine snapshot history with replay URLs, timestamps, status, MIME, digest, and size filters.

Stas Persiianenko

Wayback Machine Scraper

gio21/wayback-machine-scraper

List Internet Archive Wayback Machine snapshots for one or more URLs. Returns timestamp, snapshot URL, HTTP status, MIME type, digest. Useful for tracking website changes over time, OSINT research, content recovery, and brand monitoring.

Gio

Wayback Machine Scraper

leorochasantos/wayback-machine

Search the Internet Archive's Wayback Machine for historical snapshots of any URL or domain. Filter by date range and get the timestamp, HTTP status, MIME type, and a direct archive link for every snapshot — no API key required.

Leonardo Santos

Wayback Machine Scraper - URL Snapshot History

scrapesage/wayback-machine-scraper

Get the full Internet Archive snapshot history for any URL: capture timestamps, snapshot links, status codes, MIME types and sizes. Filter by date range and match type. No API key, no browser.

Scrape Sage

Wayback Machine Search

crawlerbros/wayback-machine-search

Query Internet Archive's Wayback Machine for historical snapshots of any URL or domain. Filter by date, HTTP status, MIME type, and deduplicate. Optionally fetch the archived page text. Free public CDX API, no authentication.

Crawler Bros

Wayback Machine Scraper: Historical URLs & Snapshots

arman-bd/wayback-machine-scraper

Query the Internet Archive CDX API: every archived URL for a domain with timestamps, status codes, MIME types and snapshot links. No login, no proxy, no browser.