arXiv Research Papers Scraper

Search arXiv's 2.5M+ open-access research papers by keyword, category, author, or paper ID. Returns clean typed JSON — no API key required. The arXiv API is a stateless XML service with no auth and no rate limits; this actor is a thin, reliable HTTP → XML → JSON wrapper.

Features

• Keyword search — search all fields for any query, including boolean AND/OR and exact phrases
• Category filter — limit results to a specific arXiv category (cs.AI, stat.ML, hep-th, etc.)
• Author search — find papers by author name
• ID lookup — fetch specific papers by arXiv ID (with or without version suffix)
• Sorting — by relevance, submission date, or last updated date, ascending or descending
• Pagination — start offset and maxResults limit (1–100)
• Typed flat JSON — one row per paper, designed for LLM / MCP consumers
• No auth, no rate limits — the arXiv API is entirely open

Use cases

• Academic literature reviews and systematic surveys
• Staying current with new papers in your field
• Training data preparation for ML/NLP research
• Citation tracking and bibliometric analysis

Input

Field	Type	Default	Description
query	string	(required)	arXiv search query. Examples: transformer, cat:cs.AI, au:bengio, 2301.00001
searchMode	enum	all	all (keyword), category, author, or idList
sortBy	enum	relevance	relevance, submittedDate, or lastUpdatedDate
sortOrder	enum	descending	descending or ascending
maxResults	integer	10	1–100 results per run
start	integer	0	Pagination offset

Output

Each dataset row is a flat paper object:

{
  "input": "transformer",
  "id": "http://arxiv.org/abs/1706.03762v7",
  "arxivId": "1706.03762v7",
  "title": "Attention Is All You Need",
  "authors": ["Ashish Vaswani", "Noam Shazeer", "Niki Parmar"],
  "abstract": "The dominant sequence transduction models are based on...",
  "categories": ["cs.CL", "cs.LG"],
  "primaryCategory": "cs.CL",
  "published": "2017-06-12T17:57:27Z",
  "updated": "2023-08-02T00:36:53Z",
  "comment": "15 pages, 5 figures",
  "journalRef": null,
  "doi": null,
  "abstractUrl": "https://arxiv.org/abs/1706.03762v7",
  "pdfUrl": "https://arxiv.org/pdf/1706.03762v7",
  "error": null,
  "scraped_at": "2026-07-28T12:00:00Z"
}

Empty results emit a single row with totalResults: 0. Error items carry a non-null error field and are never charged.

Pricing

Pay per event, and the platform usage is on us — the price you see is the price you pay, with no compute bill on top.

Event	Price	What one charge buys
arXiv paper result	$0.0002	Charged for each arXiv paper returned by the search. Empty results are never charged. Errors and parse failures are free.
Actor Start	$0.002	One run, whatever it returns.

Higher Apify subscription tiers pay less on every event (Silver −20%, Gold −35%).

Reliability

• <2% failure rate target over 30 days
• arXiv API has been stable since 2005 with no authentication and no rate limits
• All upstream parsing logic is isolated in src/source.ts for fast repair

Limitations

• No date range filtering (arXiv API does not support it — use sort + pagination instead)
• No PDF download or content extraction (links only)
• Single query per run (no multi-query batching)
• Pure arXiv only — not a multi-source academic search