Wayback Cdx Scraper
Pricing
from $0.50 / 1,000 wayback cdx rows
Wayback Cdx Scraper
Pricing
from $0.50 / 1,000 wayback cdx rows
Rating
0.0
(0)
Developer
Smorgi Apps
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
7 days ago
Last modified
Categories
Share
Wayback Machine CDX Scraper — Pay Per Result
Query the Internet Archive CDX API for archived URL captures. Paste URLs or domains — multi-URL batch with date, status, and match-type filters.
Store search keywords: Wayback Machine scraper · Internet Archive CDX · web archive captures · archive.org API · historical URLs
Why this Actor
| Need | What you get |
|---|---|
| Archive research | Timestamps, original URLs, status codes, archive links |
| Bulk lookups | Many URLs/domains in one run |
| Failures that shouldn’t bill | Empty CDX results / HTTP errors → not charged |
| Low cost | HTTP-only (no browser); PPE priced from measured unit economics |
Public CDX API only. Tries HTTPS first, then HTTP fallback.
Input
{"urls": ["example.com"],"matchType": "domain","from": "2000","to": "2003","filterStatus": "200","maxItemsPerUrl": 100,"collapse": "digest"}
Match types: domain, exact, prefix, host.
Output fields
| Field | Description |
|---|---|
urlKey | CDX urlkey identifier |
timestamp | Capture timestamp (YYYYMMDDHHMMSS) |
original | Original URL at capture time |
mimeType | Content MIME type |
statusCode | HTTP status code |
digest | Content digest hash |
length | Response body length (bytes) |
archiveUrl | Direct Wayback link (https://web.archive.org/web/{timestamp}/{original}) |
inputUrl | The input URL/domain this row came from |
scrapedAt | ISO timestamp of this run |
The first row of CDX JSON output is a header — it is skipped automatically.
Pricing
Pay-per-event for each delivered capture row.
- Empty CDX results and HTTP failures → not charged
~$0.50 / 1,000 captures on the Store pricing tab (HTTP-only; empty URLs free).
Limitations (honest)
- CDX API has rate limits — use
requestDelayMsfor large batches limitcaps rows per URL; full history may require multiple runs or advanced CDX paging- Very new captures may not appear in CDX immediately
- Archive availability depends on Internet Archive crawl policy
Issues / feature requests: use the Actor Issues tab.