Internet Archive Scraper

Wayback Machine URL Extractor - Archived URLs

logiover/wayback-machine-url-extractor

Extract every archived URL of any domain from the Internet Archive's Wayback Machine (CDX API). Recover lost or old pages, build redirect maps and run OSINT, with date and status filters. No API key, export to CSV or JSON.

Wayback Machine Archive Scraper

andok/wayback-machine-scraper

Fetch historical snapshots of any webpage from the Internet Archive. Perfect for digital forensics and tracking deleted content.

Wayback Machine Scraper - Track Website Changes Over Time

ryanclinton/wayback-machine-search

Search the Internet Archive's Wayback Machine for historical snapshots of any website. Retrieve archived page metadata -- including timestamps, URLs, MIME types, HTTP status codes, and content hashes -- for up to 10,000 snapshots per run.

Reddit Archive Scraper — Historical Posts for RAG

benthepythondev/reddit-archive-scraper

Returns historical Reddit posts and comments by subreddit, keyword and exact UTC date range from public Reddit archives: text, score, author, flair and links. Goes back years, past what Reddit's own lists show; made for RAG and research datasets. No login, no API key. Coverage varies by archive.

Internet Archive Scraper — Wayback + Search + Metadata [$1.5💰]

memo23/internet-archive-scraper

Internet Archive all-in-one scraper — paste a URL or domain for Wayback snapshot history, a keyword for library search, or an item ID for full metadata + file lists. Date filters, availability checks, flat JSON rows. Pure HTTP via open APIs, no browser, no proxies. $1.50/1k rows.

Reddit Historical Archive Scraper - Old Posts by Date

logiover/reddit-historical-archive-scraper

Pushshift alternative to scrape old Reddit posts and comments without an API key. Full-text comment search, user history, export to CSV/JSON.

Search Internet Archive and check Wayback Machine snapshots. Access 800B+ archived pages, books, movies, audio. Search items, get metadata, or check URL archive history. No API key needed. For SEO, OSINT, legal, and research.

Internet Archive Scraper

defensible_mat/internet-archive-scraper

Search and scrape Internet Archive — 40M+ free books, movies, music, software, images, and Wayback Machine web archives. Filter by media type, date, and keyword. Export data as JSON, CSV, Excel, or XML. Great for public domain content, research, and bulk metadata downloads.

Wayback Machine Extractor - Archive.org Downloader

caulleonard/wayback-extractor

Recover dead or deleted websites. Download HTML, files, and snapshot metadata from the Wayback Machine.

News Archive Scraper - Historical News Past the 100-Item Limit

vonsensey/news-archive-scraper

Pull historical news archives, not just today's headlines. Google's feed caps at about 100 articles per query; this splits your query into date windows and returns thousands, reaching back years. Real publisher URL on every row, optional full article text. Pay per article, failed runs are free.