Wayback Lost Page Finder – 404 Audit & 301 Redirect Map avatar

Wayback Lost Page Finder – 404 Audit & 301 Redirect Map

Pricing

from $1.50 / 1,000 archived url saveds

Go to Apify Store
Wayback Lost Page Finder – 404 Audit & 301 Redirect Map

Wayback Lost Page Finder – 404 Audit & 301 Redirect Map

After a site migration, list every URL the Wayback Machine archived for a domain, check which now 404 or redirect to the homepage, and export a ready 301 redirect map plus optional recovered page text. Official CDX API, no key needed. Live checks and content recovery are billed separately.

Pricing

from $1.50 / 1,000 archived url saveds

Rating

0.0

(0)

Developer

pdbear

pdbear

Maintained by Community

Actor stats

0

Bookmarked

1

Total users

0

Monthly active users

17 hours ago

Last modified

Features

Limited permissions

Share

Wayback Lost Page Finder: 404 audit and a 301 redirect map

Best for: SEO or engineering work after a redesign, CMS move or domain change, when old URLs still have backlinks and now 404 or bounce to the homepage.

Not for: downloading every historical snapshot of a page, or a general “website history” browser. Cheaper snapshot listers exist on the Store if you only need CDX rows.

Migrated a site and lost traffic? This Actor rebuilds the old URL list from the Internet Archive’s Wayback Machine (official CDX API, no key), checks each URL on the live site today, and writes a REDIRECT_MAP CSV you can paste into Nginx, Apache, Cloudflare, Netlify or a WordPress redirect plugin.

Why use this instead of a snapshot dump

  • Every archived URL for a host, a whole domain, or a URL prefix, with first-seen date and snapshot links.
  • Live classification: ok, redirected, redirects-to-homepage, lost, redirect-error, server-error, blocked-or-client-error, or unreachable.
  • Hop-by-hop redirect audit (up to 10 hops): chains, loops, temporary 302s where a 301 is expected, finals that are not 200, missing Location.
  • A suggested live target for each lost URL, scored, in REDIRECT_MAP (from,to,score,status,category).
  • Optional recovery of title, meta description, H1, word count and clean text from the latest snapshot.
  • Default noise filters: CSS/JS/images, wp-json, tracking parameters, login/token URLs, duplicate query-string variants.
  • CDX flakiness is retried with backoff. The Archive is not always up; a run can still time out on a very large domain. Set caps (maxUrlsPerDomain) and a maximum cost.

Quick start

{
"domains": ["paulgraham.com"],
"matchType": "host",
"ignoreQueryStrings": true,
"checkLiveStatus": true,
"liveCheckConcurrency": 4
}

Use cases

  • SEO site migration audit: every old URL is 200 or a single 301 to the right new page.
  • Broken backlink / link-equity recovery.
  • Soft-404 detection (deep URLs sent to the homepage).
  • Expired and aged domain research (what used to be on the domain).
  • Content recovery of deleted posts or docs (optional paid event).
  • Competitor structure over time (public archives only).

Pricing (pay per event)

EventPrice
Actor start (per run)$0.005
Archived URL saved$0.0015 ($1.50 per 1,000)
Live status check$0.0005 ($0.50 per 1,000)
Archived page content recovered$0.004 ($4 per 1,000)

Example: 1,000 unique archived URLs, all live-checked, no text recovery ≈ $2.005. Turn off live checks or content recovery when you do not need them. Set a maximum cost per run; the Actor stops cleanly and keeps what it already saved.

Limitations

  • The Wayback Machine and its CDX API can be slow or temporarily unavailable. Large domains should use maxUrlsPerDomain.
  • Suggested redirect targets are similarity suggestions, not a guarantee of the correct business URL. Review the REDIRECT_MAP before you deploy it.
  • Only public archived captures are used.

Keywords

wayback machine, lost pages, 404 audit, 301 redirect map, website migration, soft 404, redirects to homepage, CDX API, internet archive, recover deleted pages, redirect chain, broken backlinks


中文说明

这个工具做什么

用 Internet Archive 官方 CDX API(无需密钥)列出一个域名曾经被存档的 URL,检查它们今天是 404、整站跳到首页(软 404),还是重定向链有问题,并导出可交给 Nginx / Apache / Cloudflare / Netlify / WordPress 的 301 重定向表。也可选从最新快照恢复标题和正文。它不是“把所有历史快照下下来”的工具;如果只需要快照列表,商店里有更便宜的 Actor。

价格

每次启动 $0.005;每保存 1,000 条存档 URL $1.50;每次线上检查每 1,000 条 $0.50;每恢复 1,000 页正文 $4。不需要的步骤可以关掉。大型站点请设置 maxUrlsPerDomain 和单次费用上限;档案网本身有时会慢或超时。

More tools by pdbear: https://apify.com/pandabear · https://pdbear.com