Internet Archive Scraper avatar

Internet Archive Scraper

Pricing

$0.20 / 1,000 internet archive records

Go to Apify Store
Internet Archive Scraper

Internet Archive Scraper

Fast, lightweight scraper for Internet Archive (archive.org). Extract metadata, collections, media files, and item URLs using Lucene queries directly into JSON, CSV, or Excel with zero browser overhead.

Pricing

$0.20 / 1,000 internet archive records

Rating

0.0

(0)

Developer

Ludovic Ertzer

Ludovic Ertzer

Maintained by Community

Actor stats

1

Bookmarked

2

Total users

1

Monthly active users

2 days ago

Last modified

Categories

Share

Internet Archive Scraper & Search API

Extract structured metadata, collections, books, movies, audio recordings, and archived items from Internet Archive (archive.org) using flexible search queries.

This Actor connects directly to Internet Archive's cursor-based search engine. It runs without headless browser overhead, ensuring maximum speed, minimal compute costs, and zero bot detection issues.


Features

  • Blazing Fast & Lightweight: Uses raw HTTP extraction (no Puppeteer/Playwright). Runs reliably on 256 MB RAM.
  • Full Lucene Search Support: Filter by collection, creator, date, media type, language, or license.
  • Deep Pagination: Automatically traverses cursor-based pagination beyond the typical 10,000-item API limits.
  • Clean Normalization: Automatically generates direct item URLs (https://archive.org/details/{identifier}) for every result.
  • Export Ready: Output structured data directly to JSON, CSV, XML, or Excel.

Input Parameters

ParameterTypeRequiredDefaultDescription
queryStringYes"collection:nasa"Lucene search query.
fieldsArrayNo["identifier", "title", "mediatype", "creator", "date", "downloads"]Specific metadata attributes to extract per record.
maxItemsIntegerNo1000Maximum number of records to collect before stopping.
batchSizeIntegerNo1000Results requested per API batch (range: 100–10,000).

Query Syntax & Examples

Internet Archive queries follow standard Lucene syntax. You can combine terms with AND, OR, NOT, and field qualifiers:

Target Use CaseExample Query
Specific collectioncollection:nasa
Books published in a specific yearmediatype:texts AND year:2023
Audio files by a specific artistmediatype:audio AND creator:"Grateful Dead"
High-download historical itemsdownloads:[10000 TO *] AND year:[1900 TO 1950]
Keyword search in titlestitle:apollo AND mediatype:movies

Output Format

Each row in the dataset contains the requested fields along with a generated itemUrl:

[
{
"identifier": "00-042-71",
"title": "Space Shuttle Cockpit exhibit",
"mediatype": "image",
"creator": "NASA/Stennis Space Center",
"date": "2000-01-01T00:00:00Z",
"downloads": 4832,
"itemUrl": "[https://archive.org/details/00-042-71](https://archive.org/details/00-042-71)"
},
{
"identifier": "00-042-154",
"title": "International Space Station exhibit",
"mediatype": "image",
"creator": "NASA/Stennis Space Center",
"date": "2000-05-26T00:00:00Z",
"downloads": 1385,
"itemUrl": "[https://archive.org/details/00-042-154](https://archive.org/details/00-042-154)"
}
]