Wayback Machine CDX Snapshot Lister
Pricing
from $1.50 / 1,000 results
Wayback Machine CDX Snapshot Lister
List Internet Archive Wayback Machine CDX snapshots for one or more URLs. Returns CDX metadata and wayback snapshot URLs only — no archived HTML bodies.
Pricing
from $1.50 / 1,000 results
Rating
0.0
(0)
Developer
Bryce
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
2 days ago
Last modified
Categories
Security
Limited permissionsShare
List Internet Archive Wayback Machine captures for one or more URLs using the public CDX API.
The Actor returns CDX metadata and ready-to-use Wayback snapshot URLs — it does not download or scrape archived HTML page bodies.
What you get
For each matching capture you typically receive:
| Field | Description |
|---|---|
url | The query URL / pattern you provided |
timestamp | Capture time (YYYYMMDDhhmmss) |
original | Original URL from the CDX index |
mimetype | Recorded MIME type |
statuscode | Recorded HTTP status |
digest | Content digest |
length | Recorded length |
snapshotUrl | https://web.archive.org/web/{timestamp}/{original} |
Input
- urls (required) — one or more URLs or URL patterns
- matchType —
exact(default),prefix,host, ordomain - from / to — optional CDX time bounds (
YYYYMMDDhhmmss, partial allowed) - filter — optional CDX filters (e.g.
statuscode:200) - collapse — optional CDX collapse (e.g.
digest,timestamp:6) - limit — max snapshots per input URL (default 100)
- fl — optional CDX field list (defaults to the fields above)
Example
How it works
- Calls
https://web.archive.org/cdx/search/cdxwithoutput=json. - Sends a descriptive User-Agent and stays around ~48–60 requests/minute.
- Honors HTTP 429
Retry-After. - Paginates with CDX
resumeKeywhen needed. - Writes one dataset item per snapshot row (metadata +
snapshotUrlonly).
Pricing (pay-per-event)
Configured for Store use as:
- $0.01 per Actor start (
apify-actor-start) - $0.0015 per snapshot row written to the default dataset (
apify-default-dataset-item)
Limitations & rules
- No HTML scraping of
archive.org/web.archive.orgpages. - No contact harvesting.
- No residential / upgraded proxies — plain HTTP to the public CDX endpoint.
- Be respectful of Internet Archive rate limits; keep
limitmodest for exploration.
Use cases
- Discover historical captures before deep research
- Build a list of Wayback URLs for QA, citations, or change tracking
- Filter captures by status code, MIME type, or time range
Output
Open the run’s Dataset tab (or download via API). Each item is one CDX row plus snapshotUrl.
