Wayback Cdx Scraper avatar

Wayback Cdx Scraper

Pricing

from $0.50 / 1,000 wayback cdx rows

Go to Apify Store
Wayback Cdx Scraper

Wayback Cdx Scraper

Pricing

from $0.50 / 1,000 wayback cdx rows

Rating

0.0

(0)

Developer

Smorgi Apps

Smorgi Apps

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

7 days ago

Last modified

Share

Wayback Machine CDX Scraper — Pay Per Result

Query the Internet Archive CDX API for archived URL captures. Paste URLs or domains — multi-URL batch with date, status, and match-type filters.

Store search keywords: Wayback Machine scraper · Internet Archive CDX · web archive captures · archive.org API · historical URLs


Why this Actor

NeedWhat you get
Archive researchTimestamps, original URLs, status codes, archive links
Bulk lookupsMany URLs/domains in one run
Failures that shouldn’t billEmpty CDX results / HTTP errors → not charged
Low costHTTP-only (no browser); PPE priced from measured unit economics

Public CDX API only. Tries HTTPS first, then HTTP fallback.


Input

{
"urls": ["example.com"],
"matchType": "domain",
"from": "2000",
"to": "2003",
"filterStatus": "200",
"maxItemsPerUrl": 100,
"collapse": "digest"
}

Match types: domain, exact, prefix, host.


Output fields

FieldDescription
urlKeyCDX urlkey identifier
timestampCapture timestamp (YYYYMMDDHHMMSS)
originalOriginal URL at capture time
mimeTypeContent MIME type
statusCodeHTTP status code
digestContent digest hash
lengthResponse body length (bytes)
archiveUrlDirect Wayback link (https://web.archive.org/web/{timestamp}/{original})
inputUrlThe input URL/domain this row came from
scrapedAtISO timestamp of this run

The first row of CDX JSON output is a header — it is skipped automatically.


Pricing

Pay-per-event for each delivered capture row.

  • Empty CDX results and HTTP failures → not charged

~$0.50 / 1,000 captures on the Store pricing tab (HTTP-only; empty URLs free).


Limitations (honest)

  • CDX API has rate limits — use requestDelayMs for large batches
  • limit caps rows per URL; full history may require multiple runs or advanced CDX paging
  • Very new captures may not appear in CDX immediately
  • Archive availability depends on Internet Archive crawl policy

Issues / feature requests: use the Actor Issues tab.