arXiv Scraper — Papers, Abstracts, Authors & PDFs

Search arXiv by keywords, categories (cs.AI, cs.CL, cs.LG, stat.ML, q-fin...), authors and submission date range, newest first or by relevance, or fetch papers by ID or URL. For each paper: title, abstract, authors (and affiliations when given), primary and all categories, submission and update dates, version, DOI, journal reference, comments and the PDF link. Uses the official arXiv API.

Built for AI and research monitoring, literature reviews, trend analysis, newsletters, and AI / RAG datasets.

Why this one

• Category + date filters combined with any keywords, so you get, for example, every cs.AI paper about agents submitted this month.
• arXiv query syntax supported (ti:, abs:, au:).
• Respects the arXiv API terms (one request every 3 seconds) for reliable runs.

Input

LLM agent papers in cs.AI submitted since October:

{
  "searchQueries": ["llm agents"],
  "categories": ["cs.AI"],
  "dateFrom": "2026-10-01",
  "sortBy": "submitted",
  "maxPapersPerSearch": 500
}

Output

Field	Description
arxivId, version, title, abstract, url, pdfUrl	paper
authors, authorsWithAffiliation	authors
primaryCategory, categories	subjects
published, updated, doi, journalRef, comment	metadata

Example output

One real item from a test run (long texts and lists shortened):

{
  "type": "paper",
  "arxivId": "2611.03434",
  "version": "v1",
  "title": "Optimize the Harness, Not the Model: Fitting a Minimal Agent to a Self-Hostable LLM for Investigative Analysis",
  "abstract": "Government intelligence teams need LLM agents that can analyze large, messy evidence collections, but security and cost constraints often rule out hosted fro...",
  "authors": [
    "Shai Nahum Gefen",
    "Vered Chassida",
    "Dmitry Basin"
  ],
  "authorsWithAffiliation": [],
  "primaryCategory": "cs.AI",
  "categories": [
    "cs.AI",
    "cs.CL",
    "cs.MA"
  ],
  "published": "2026-11-02T16:53:29Z",
  "updated": "2026-11-02T16:53:29Z",
  "doi": "10.1145/3799682.3839256",
  "journalRef": null,
  "comment": "3 pages, 1 table. Industry Day talk at CIKM 2026, Rome, 7 November 2026",
  "url": "https://arxiv.org/abs/2611.03434",
  "pdfUrl": "https://arxiv.org/pdf/2611.03434v1",
  "search": "llm agents"
}

Notes

• Thank you to arXiv for use of its open access interoperability.

Feedback

Found a problem or need a field? Open an issue in the Issues tab: every issue is read and answered. If the actor helped you, a review on the Store helps a lot.

How much does it cost?

You pay only for results delivered, at a fixed price per item. Apify platform usage is included in that price, so there are no compute costs on top. Errors and items that couldn't be found are free.

What you get	Price	Example
Paper	$0.0005 each	1,000 papers = $0.50

The Apify Free plan includes $5 of monthly credit, enough for about 10,000 papers per month at no cost. You can also set a maximum spend per run.

On paid Apify plans it gets cheaper automatically: 10% off on Starter, 20% on Scale and 30% on Business.