Wayback Machine Scraper: Domain Age Checker, Archived URL Extractor, Dead Page Finder & Internet Archive API

A Wayback Machine scraper and Internet Archive API alternative. Get Wayback Machine data in bulk — domain age, snapshots, archived URLs and page content — without an API key:

• 🕰️ Domain age checker: first and last archive date, site age in years, and the years the site was active, for hundreds of domains at once.
• 📈 Snapshot history and change timeline: every capture of a URL, or only the captures where content changed, with HTTP status, content hash and a direct archive link.
• 🔗 All archived URLs of a website + dead page finder: every distinct URL the Wayback Machine has seen for a domain. You can also check each one on the live site to find pages that now return 404, error out or redirect. Use it for SEO redirect mapping, backlink recovery and site migrations.
• 📝 Archived page content as clean text and Markdown: the version of a page closest to any date, with title, meta description, H1s, word count, plain text and Markdown. It's ready for LLMs, RAG, research, legal evidence and competitor analysis.

Who uses it

Use case	Mode
Domain investors, M&A and due diligence: how old is this site really?	domainAge
Lead scoring: established businesses vs. brand-new sites	domainAge
SEO: find old URLs that now 404 and lost backlinks, and build a 301 redirect map	archivedUrls + checkLiveStatus
Competitor monitoring: when did their pricing or homepage change?	snapshots with onlyChanges
Content recovery after a lost CMS or expired domain	archivedUrls → pageContent
AI / RAG datasets of historical web pages	pageContent
OSINT, journalism, legal: what did a page say on a given date?	pageContent with snapshotDate

Search terms this listing covers: Wayback Machine scraper, Internet Archive API, domain age checker, archived page downloader, website history checker, dead page finder, CDX API.

How to use

1. Pick a mode.
2. Add domains or URLs (example.com or https://example.com/pricing).
3. Optionally set dates, a status filter, or live checks.
4. Run, then download results as JSON, CSV, Excel or HTML, or get them through the Apify API.

Example input

{
  "mode": "archivedUrls",
  "targets": ["example.com"],
  "htmlOnly": true,
  "checkLiveStatus": true,
  "maxItemsPerTarget": 5000
}

Example output

Domain age

{
  "type": "domainAge",
  "domain": "apify.com",
  "archived": true,
  "firstCapture": "2007-05-31T10:15:38+00:00",
  "lastCapture": "2026-10-31T18:01:16+00:00",
  "ageYears": 19.43,
  "activeYears": ["2007", "2008", "2011", "…", "2026"],
  "activeYearCount": 18,
  "firstArchiveUrl": "https://web.archive.org/web/20070531101538/http://www.apify.com:80/"
}

Archived URL + live check

{
  "type": "archivedUrl",
  "url": "https://jackknife.io/.well-known/ai-plugin.json",
  "firstCapture": "2025-10-17T02:46:17+00:00",
  "statusCode": "404",
  "liveStatus": 404,
  "isDead": true,
  "archiveUrl": "https://web.archive.org/web/20251017024617/https://jackknife.io/.well-known/ai-plugin.json"
}

Page content

{
  "type": "pageContent",
  "url": "https://news.ycombinator.com/",
  "timestamp": "2015-01-02T02:00:25+00:00",
  "title": "Hacker News",
  "wordCount": 589,
  "text": "Hacker News\nnew | comments | …",
  "markdown": "…"
}

Input reference

Field	Description
mode	domainAge, snapshots, archivedUrls or pageContent
targets	Domains or URLs
fromDate / toDate	YYYY, YYYYMM or YYYYMMDD (snapshots, archivedUrls)
onlyChanges	Snapshots: skip captures with identical content (default true)
statusFilter	Keep only captures with this archived HTTP status, e.g. 200
htmlOnly	archivedUrls: HTML pages only (default true)
checkLiveStatus	archivedUrls: check each URL on the live site now
snapshotDate	pageContent: capture closest to this date (default: latest)
maxItemsPerTarget	Limit per domain or URL (default 1000)
maxConcurrency	Parallel requests (default 3; please be gentle with archive.org)

Pricing (pay per event)

You pay only for results. There's no subscription and no proxy cost.

Event	Price
Domain age summary	$4 per 1,000 domains
Snapshot record	$0.50 per 1,000 snapshots
Archived URL (incl. live check)	$0.80 per 1,000 URLs
Archived page content (text + Markdown)	$4 per 1,000 pages

Set a maximum charge per run and the Actor stops cleanly when it hits it. Failed targets are reported with type: "error" and are never charged.

FAQ

Is this legal? Yes. The Actor only uses the Internet Archive's public, documented endpoints (the CDX server and raw snapshots). It doesn't log in or bypass anything, and it identifies itself with a clear User-Agent. Archived content belongs to its original owners, so make sure your use is lawful (research, SEO, due diligence and similar).

Why is a domain "not archived"? The Wayback Machine has no captures of its homepage. That usually means a brand-new or never-public site.

Why do some snapshots show contentChanged: true very often? Some sites put timestamps or tokens in every page, and http, https and www variants can differ. Use statusFilter: "200" and target the exact URL you care about.

Is there an API or integration? Yes. You can run it through the Apify API, Make, Zapier, n8n or LangChain, or call it as a tool from AI agents through the Apify MCP server.

---

Not affiliated with the Internet Archive. If you rely on the Wayback Machine, please consider donating to the Internet Archive.