Internet Archive Scraper
Pricing
$0.20 / 1,000 internet archive records
Internet Archive Scraper
Fast, lightweight scraper for Internet Archive (archive.org). Extract metadata, collections, media files, and item URLs using Lucene queries directly into JSON, CSV, or Excel with zero browser overhead.
Pricing
$0.20 / 1,000 internet archive records
Rating
0.0
(0)
Developer
Ludovic Ertzer
Maintained by CommunityActor stats
1
Bookmarked
2
Total users
1
Monthly active users
2 days ago
Last modified
Categories
Share
Internet Archive Scraper & Search API
Extract structured metadata, collections, books, movies, audio recordings, and archived items from Internet Archive (archive.org) using flexible search queries.
This Actor connects directly to Internet Archive's cursor-based search engine. It runs without headless browser overhead, ensuring maximum speed, minimal compute costs, and zero bot detection issues.
Features
- Blazing Fast & Lightweight: Uses raw HTTP extraction (no Puppeteer/Playwright). Runs reliably on 256 MB RAM.
- Full Lucene Search Support: Filter by collection, creator, date, media type, language, or license.
- Deep Pagination: Automatically traverses cursor-based pagination beyond the typical 10,000-item API limits.
- Clean Normalization: Automatically generates direct item URLs (
https://archive.org/details/{identifier}) for every result. - Export Ready: Output structured data directly to JSON, CSV, XML, or Excel.
Input Parameters
| Parameter | Type | Required | Default | Description |
|---|---|---|---|---|
query | String | Yes | "collection:nasa" | Lucene search query. |
fields | Array | No | ["identifier", "title", "mediatype", "creator", "date", "downloads"] | Specific metadata attributes to extract per record. |
maxItems | Integer | No | 1000 | Maximum number of records to collect before stopping. |
batchSize | Integer | No | 1000 | Results requested per API batch (range: 100–10,000). |
Query Syntax & Examples
Internet Archive queries follow standard Lucene syntax. You can combine terms with AND, OR, NOT, and field qualifiers:
| Target Use Case | Example Query |
|---|---|
| Specific collection | collection:nasa |
| Books published in a specific year | mediatype:texts AND year:2023 |
| Audio files by a specific artist | mediatype:audio AND creator:"Grateful Dead" |
| High-download historical items | downloads:[10000 TO *] AND year:[1900 TO 1950] |
| Keyword search in titles | title:apollo AND mediatype:movies |
Output Format
Each row in the dataset contains the requested fields along with a generated itemUrl:
[{"identifier": "00-042-71","title": "Space Shuttle Cockpit exhibit","mediatype": "image","creator": "NASA/Stennis Space Center","date": "2000-01-01T00:00:00Z","downloads": 4832,"itemUrl": "[https://archive.org/details/00-042-71](https://archive.org/details/00-042-71)"},{"identifier": "00-042-154","title": "International Space Station exhibit","mediatype": "image","creator": "NASA/Stennis Space Center","date": "2000-05-26T00:00:00Z","downloads": 1385,"itemUrl": "[https://archive.org/details/00-042-154](https://archive.org/details/00-042-154)"}]