arXiv Scraper

Scrape arXiv papers by category or keyword — title, abstract, authors, categories, publish dates, and PDF links — with no API key. A fast, reliable feed for research monitoring, literature reviews, and building paper datasets.

Pick a category (like cs.AI or stat.ML) or type a keyword, and get a clean, structured list of the newest papers, ready to export to CSV, Excel, or JSON.

Features

• Official arXiv API — reads arXiv's public Atom API. Nothing to configure — runs just work.
• No API key, no quota — no account, no tokens, no per-day cap.
• Fresh, ranked results — papers are returned newest-first (submittedDate, descending), paginated in blocks of 100.
• Polite by design — waits ~3 seconds between requests, as arXiv asks.

Use cases

• Research monitoring — track the newest papers in a field every day.
• Literature reviews — collect papers by category and keyword into one dataset.
• AI / ML pipelines — feed abstracts and metadata into embeddings or an LLM.
• Daily research digests — schedule the Actor and email yourself new papers.

Input

Field	Type	Description
categories	string[]	arXiv category codes, e.g. cs.AI, cs.CL, cs.CV, cs.LG, stat.ML. One query per category.
searchQueries	string[]	Optional keywords (title, abstract, authors), combined with categories.
maxItems	integer	Max papers per query. Default 50.

Provide at least one of categories or searchQueries. If both are empty, the Actor defaults to cat:cs.AI.

Example

{
  "categories": ["cs.AI", "cs.CL"],
  "searchQueries": ["agent"],
  "maxItems": 50
}

Output

{
  "arxivId": "2408.01234",
  "title": "A Great Paper About Transformers",
  "summary": "We propose …",
  "authors": ["Ada Lovelace", "Alan Turing"],
  "primaryCategory": "cs.CL",
  "categories": ["cs.CL", "cs.AI", "cs.LG"],
  "published": "2026-08-10T17:59:51.000Z",
  "updated": "2026-08-10T17:59:51.000Z",
  "pdfUrl": "https://arxiv.org/pdf/2408.01234v1",
  "absUrl": "http://arxiv.org/abs/2408.01234v1",
  "doi": null,
  "comment": "Accepted at NeurIPS 2026",
  "query": "cat:cs.CL",
  "scrapedAt": "2026-08-11T19:00:00.000Z"
}

Download the dataset as JSON, CSV, Excel, or XML, or pull it via the Apify API. Schedule the Actor to keep a rolling feed of new papers for any topic.

Pricing

Pay-per-event: $0.01 per run start (per GB of run memory) plus $0.50 per 1,000 papers. You only pay for papers actually returned. See the Pricing tab for current rates.

FAQ

Do I need an arXiv API key? No. This Actor reads arXiv's public Atom API — no key, no account, no quota.

How are papers ordered? Newest first, by submission date (sortBy=submittedDate&sortOrder=descending).

How many papers can I get? Up to maxItems per query, fetched in pages of 100. Combine categories and keywords for narrower, deeper coverage.

Can I export to CSV or Excel? Yes. Every run's dataset downloads as CSV, Excel, JSON, or XML, or via the Apify API.

Disclaimer

This is an unofficial Actor. It is not affiliated with, endorsed by, or sponsored by arXiv or Cornell University. Thank you to arXiv for use of its open access interoperability.

The Actor collects only publicly available information from the official arXiv API. You are responsible for how you use the collected data, including compliance with applicable law and arXiv's terms of use.