Pricing

$2.00 / 1,000 dataset items

Internet Archive Scraper & Data Extractor

Search Internet Archive and export structured metadata, file inventories, checksums, and direct download links to JSON, CSV, Excel, or API.

Pricing

$2.00 / 1,000 dataset items

Rating

0.0

(0)

Developer

xinyao a

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Internet Archive Data Extractor

Search the Internet Archive catalog and export clean, structured records for research, AI pipelines, digital humanities, media discovery, and archival analysis.

The Actor uses Internet Archive's public APIs. It does not require cookies, login credentials, browser automation, or proxies.

What you get

Each dataset item can contain:

Internet Archive identifier and canonical item URL
title, creator, date, year, description, and media type
downloads, collections, subjects, and languages
license, public date, and added date
optional full metadata
optional downloadable file inventory
file format, size, SHA-1, MD5, and direct download URL

Results are available through the Apify dataset as JSON, CSV, Excel, XML, RSS, or via API and integrations.

Example input

{
  "query": "collection:nasa",
  "mediaType": "texts",
  "yearFrom": 2010,
  "yearTo": 2026,
  "sortBy": "downloads desc",
  "maxItems": 100,
  "includeMetadata": true,
  "includeFiles": true,
  "fileLimit": 25
}

Plain-text searches also work:

{
  "query": "climate change",
  "mediaType": "movies",
  "maxItems": 50
}

Internet Archive advanced-search clauses can be used in query, including collection:, creator:, subject:, and boolean operators.

Example output

{
  "identifier": "Expedition-1-Resource-Reel",
  "title": "Expedition 1 Resource Reel",
  "creator": ["john.l.stoll@nasa.gov"],
  "date": "2020-11-04T00:00:00Z",
  "year": 2020,
  "mediaType": "texts",
  "downloads": 622,
  "collections": ["jsc-pao-video-collection", "nasa"],
  "detailsUrl": "https://archive.org/details/Expedition-1-Resource-Reel",
  "downloadBaseUrl": "https://archive.org/download/Expedition-1-Resource-Reel/",
  "files": [
    {
      "name": "example.mp4",
      "format": "h.264",
      "size": 48210560,
      "sha1": "dae4d840cad6cf8ea92ef468e84e1d59fb24fc70",
      "downloadUrl": "https://archive.org/download/Expedition-1-Resource-Reel/example.mp4"
    }
  ]
}

Input fields

Field	Description
`query`	Required plain-text or Internet Archive advanced-search query
`mediaType`	Optional texts, movies, audio, software, image, or web filter
`yearFrom` / `yearTo`	Optional inclusive year range
`sortBy`	Most downloaded, newest, oldest, or title A-Z
`maxItems`	Maximum records, from 1 to 10,000
`includeMetadata`	Fetch the complete metadata object for every record
`includeFiles`	Include downloadable file records and checksums
`fileLimit`	Maximum file entries included per item

Cost and performance

Basic catalog searches use a single paginated public endpoint and are inexpensive. Enabling full metadata or files performs an additional request per item and therefore takes longer. The Actor uses bounded concurrency and retries temporary HTTP failures.

Start with a small maxItems value to verify your query before a large run.

Responsible use

Internet Archive records can have different licenses and access conditions. A downloadable URL does not automatically grant permission to reuse or redistribute its content. Check each item's license and applicable law before reuse.

This Actor is an independent data tool and is not affiliated with or endorsed by Internet Archive.

Internet Archive Scraper

truenorth/internet-archive-scraper

Search archive.org and export books, audio, video, software, images, metadata, and file lists as structured JSON or CSV.

TrueNorth

Book Data Scraper: ISBN & Title Lookup

scrapemint/book-data-scraper

Look up books in bulk by ISBN or by title and author. For each book: title, author, first publish year, pages, publisher, subjects, languages, reader rating and cover image URL. Perfect for book sellers, store listings and reading apps. No API key needed.

Ken M

📚 Open Library Intelligence - 20M+ Books & Covers

benthepythondev/openlibrary-book-intelligence

Search and extract book data from Open Library's database of 20+ million books. Get titles, authors, publishers, publication dates, ISBNs, covers, subjects, and edition info. Search by title, author, ISBN, or subject. Free alternative to Google Books API.

Ben

Internet Archive Scraper — Wayback + Search + Metadata [$1.5💰]

memo23/internet-archive-scraper

Internet Archive all-in-one scraper — paste a URL or domain for Wayback snapshot history, a keyword for library search, or an item ID for full metadata + file lists. Date filters, availability checks, flat JSON rows. Pure HTTP via open APIs, no browser, no proxies. $1.50/1k rows.

Muhamed Didovic

US Census Bureau Scraper

parseforge/us-census-bureau-scraper

Extract comprehensive Census data from the US Census Bureau API. Supports search queries and direct table IDs to retrieve metadata, variables, geographic details, and values from surveys like ACS, Decennial Census, Economic Census, and more, providing structured data for analysis and research.

ParseForge

Open Citations Scraper

parseforge/open-citations-scraper

Comprehensive OpenCitations scraper for extracting citation and reference data from OpenCitations API. Perfect for researchers, academics, and data scientists who need automated access to citation networks, bibliographic metadata, and citation analysis data.

ParseForge

NASA Reports Scraper

parseforge/nasa-reports-scraper

Access NASA’s Technical Reports Server (NTRS) with an automated scraper that collects scientific papers, conference proceedings, journal articles, and research reports. Provides structured metadata for researchers, scientists, and academics needing large-scale access to NASA’s technical publications

ParseForge

Wayback Machine CDX URL List Scraper

parseforge/wayback-cdx-scraper

Pull every archived URL the Internet Archive has captured for any domain or URL prefix. Get timestamps, MIME types, status codes, content digests, and direct snapshot links. Filter by date range, status, MIME, and uniqueness. Export to JSON, CSV, or Excel for SEO recovery and competitive research.

ParseForge

Crossref DOI Metadata Scraper

parseforge/crossref-scraper

Export citation metadata for 155M+ DOIs from the Crossref Works API. Every published research paper, book chapter, conference proceeding, and dataset with a DOI. Search by query, filter by publisher, funder, type, or year range.

ParseForge

5.0

(1)

Wayback Machine URL Extractor - Archived URLs

logiover/wayback-machine-url-extractor

Extract every archived URL of any domain from the Internet Archive's Wayback Machine (CDX API). Recover lost or old pages, build redirect maps and run OSINT, with date and status filters. No API key, export to CSV or JSON.

Logiover

arXiv Preprint Scraper

parseforge/arxiv-scraper

Export preprints from arXiv.org. Search 2.5M+ open-access papers across physics, mathematics, computer science, biology, economics, and quantitative finance. Query by keyword, author, category, or date range. Pull titles, authors, abstracts, categories, DOIs, journal refs, and PDF links.

ParseForge

5.0

(1)