Wayback Machine Scraper: All Archived URLs & Snapshots avatar

Wayback Machine Scraper: All Archived URLs & Snapshots

Pricing

from $0.15 / 1,000 result saveds

Go to Apify Store
Wayback Machine Scraper: All Archived URLs & Snapshots

Wayback Machine Scraper: All Archived URLs & Snapshots

Get every URL the Wayback Machine (archive.org) ever captured for a domain, or the full snapshot history of a page: timestamp, status code, MIME type, size and direct archive links. Filters for status, file type and dates. Great for SEO, content recovery and recon.

Pricing

from $0.15 / 1,000 result saveds

Rating

0.0

(0)

Developer

veenkes

veenkes

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

21 hours ago

Last modified

Features

Limited permissions

Share

A Wayback Machine scraper for the archive.org CDX index. Get every URL ever archived for a domain (deduplicated) or the full snapshot history of a page, each with capture date, HTTP status, MIME type, size and a direct archive link.

Filter by status code, file type and date range. No API key.

Why use this Wayback Machine scraper?

  • 🗂️ All unique URLs of a domain — find old pages, lost content, forgotten files and URL structures.
  • 🕰️ Snapshot history of any page, deduplicated by content (only captures where the page changed).
  • 🔎 Filters: HTTP 200 only, MIME types (HTML, PDF, images…), date range, subdomains.
  • 🔗 Archive links in normal and raw (id_) form for direct download.
  • 💸 $0.15–$0.30 per 1,000 results, far below other Wayback actors.
  • 💸 From $0.15 per 1,000 results. No monthly rental.

Who is it for?

  • SEO specialists: recover lost pages and backlinks after migrations, audit old URL structures.
  • Content teams: find and restore deleted articles.
  • Security researchers: map historical endpoints and files of a target (authorized testing only).
  • Researchers and journalists: track how a page changed over time.

What data does it extract?

FieldExample
urlhttps://apify.com/agentx/tiktok-live-profile/output-schema
timestamp2026-02-17T20:16:16Z
statusCode, mimeType, length, digest200, text/html, 74011
archiveUrl, rawArchiveUrlhttps://web.archive.org/web/20260217201616/https://apify.com/...

How to use it

  1. Enter domains (URL mode) or page URLs (snapshot mode).
  2. Optionally set filters and max results.
  3. Click Start and export to CSV, Excel or JSON.

Run it from the API

You can start this Actor from any language with the official Apify API client. Replace YOUR_APIFY_TOKEN with a token from Apify Console > Integrations. Never put the token in a public repo.

Python

from apify_client import ApifyClient
client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("veenkes/veenkes-wayback-urls").call(run_input={
"targets": [
"openai.com"
],
"mode": "urls",
"mimeTypes": [
"text/html"
],
"maxResultsPerTarget": 5000
})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)

JavaScript

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: process.env.APIFY_TOKEN });
const run = await client.actor('veenkes/veenkes-wayback-urls').call({
"targets": [
"openai.com"
],
"mode": "urls",
"mimeTypes": [
"text/html"
],
"maxResultsPerTarget": 5000
});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

Schedule the Actor, send results to a webhook, or connect it in Zapier, Make or n8n. Store page: https://apify.com/veenkes/veenkes-wayback-urls.

Use from AI agents (Apify MCP)

AI agents can run this Actor through the Apify MCP server. Connect Claude, Cursor or any MCP-compatible client to Apify, then ask the agent to call veenkes/veenkes-wayback-urls with an input like the example above. The agent discovers the tool from the Actor title and description.

How much does it cost?

Apify plan tierPrice per 1,000 results
FREE$0.30
BRONZE$0.25
SILVER$0.20
GOLD and above$0.15

There is also a $0.00005 start fee per run.

Input example

{
"targets": [
"openai.com/blog"
],
"mode": "urls",
"includeSubdomains": false,
"onlyStatus200": true,
"mimeTypes": [
"text/html"
],
"fromDate": "2023-01-01",
"maxResultsPerTarget": 1000
}

Output example

{
"target": "apify.com",
"url": "https://apify.com/agentx/tiktok-live-profile/output-schema",
"timestamp": "2026-02-17T20:16:16Z",
"statusCode": 200,
"mimeType": "text/html",
"length": 74011,
"archiveUrl": "https://web.archive.org/web/20260217201616/https://apify.com/agentx/tiktok-live-profile/output-schema"
}

The key-value store record SUMMARY lists every input with its status and the number of items saved.

Limitations

  • The Wayback Machine index can be slow: a large domain may take a minute per few thousand URLs, and archive.org sometimes returns temporary errors (retried automatically).
  • In URL mode each URL appears once with its first matching capture.
  • Only what archive.org has captured is available.

Why this one?

URL and snapshot modes, practical filters and the lowest price per result, with automatic retries for archive.org hiccups.

FAQ

Do I need an archive.org account? No.

Why is a run slow? archive.org's index is slow for big domains; narrow with a path, file type or date range.

Is it legal? It reads archive.org's public index. Use it for lawful purposes.


Integrations

  • Apify API — Python and JavaScript clients (examples above), plus a REST API.
  • AI agents — run it via the Apify MCP server.
  • Automation tools — Zapier, Make, n8n, or an Apify webhook when a run finishes.
  • Export — download the dataset as JSON, CSV, Excel or XML, or load it from a scheduled run.

Open the Actor in Apify Store.

Not affiliated with or endorsed by the Internet Archive.