arXiv Paper Scraper - Metadata, Abstracts & PDF Links avatar

arXiv Paper Scraper - Metadata, Abstracts & PDF Links

Pricing

from $5.00 / 1,000 arxiv paper rows

Go to Apify Store
arXiv Paper Scraper - Metadata, Abstracts & PDF Links

arXiv Paper Scraper - Metadata, Abstracts & PDF Links

Scrape arXiv paper metadata into structured JSON: title, abstract, authors, categories, published and updated dates, DOI, journal reference and direct PDF links. Public arXiv Atom API, no API key. Pay per paper result at $0.005 — $0.10 for a 20-paper batch. Filter by query, category or date range.

Pricing

from $5.00 / 1,000 arxiv paper rows

Rating

0.0

(0)

Developer

ttgi

ttgi

Maintained by Community

Actor stats

0

Bookmarked

3

Total users

2

Monthly active users

18 days ago

Last modified

Categories

Share

arXiv Paper Scraper

Search arXiv and get full paper metadata: authors, abstract, categories, publication and update dates, DOI, journal reference and links.

Why this exists

Across the Apify Store's listings there is no dedicated arXiv scraper. The research and AI-audit crowd is a distinct audience from the developer-tool crowd, and arXiv's API is free, public, and needs no key.

Usage

Full arXiv query syntax, or just a category:

{
"category": "cs.CL", // cs.AI, cs.CL, cs.LG, cs.RO, q-bio.BM...
"searchQuery": "cat:cs.CL AND all:transformer",
"sortBy": "submittedDate", // relevance | lastUpdatedDate | submittedDate
"sortOrder": "descending",
"maxItems": 100
}

searchQuery wins over category when both are set.

Output

One row per paper:

id, title, summary, authors, authorCount, published, updated, categories, primaryCategory, comment, journalRef, doi, url, pdfUrl

Use cases

  • Literature review — pull a category's newest submissions with abstracts
  • Author tracking — au:Name or search_query=au:hinton for a lab's output
  • Trend detection — sort by submittedDate to see what is emerging
  • Citation inputs — doi and journalRef where arXiv records them
  • Competitive research — track a competitor's publication cadence

Honest notes

  • arXiv's API asks callers to wait roughly 3 seconds between requests. This actor honours that, so large runs are intentionally not instant.
  • comment often holds the venue and acceptance status ("Accepted at NeurIPS 2026") — useful, but free-text and not always present.
  • journalRef and doi are only populated for published papers, so expect nulls on preprints.
  • categories is comma-separated and can include cross-lists; use primaryCategory when you need exactly one.

Pronouns: they/them.