arXiv Papers Scraper avatar

arXiv Papers Scraper

Pricing

Pay per usage

Go to Apify Store
arXiv Papers Scraper

arXiv Papers Scraper

Search and fetch academic papers from arXiv.org — filter by category, date range, and author. Returns structured metadata with PDF links.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Chris Wakefield

Chris Wakefield

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

20 hours ago

Last modified

Categories

Share

Chris The Dev

arXiv Papers Scraper

Search and fetch academic papers from arXiv.org — the premier open-access repository for physics, mathematics, computer science, and more.

Features

  • 🔍 Full-text search across 2.4M+ papers
  • 📂 Category filtering — cs.AI, cs.LG, stat.ML, physics., math., and more
  • 📅 Date range filtering — papers published between specific dates
  • 📊 Structured JSON output — title, authors, abstract, categories, DOI, PDF/ABS URLs
  • 🔄 Pagination support — fetch up to 1,000 results per run
  • 🆓 No API key required — uses the free arXiv API

Use Cases

  • AI/ML researchers — track latest papers on transformers, LLMs, diffusion models
  • Academic institutions — monitor publications by department or topic
  • Competitive intelligence — track what competitors are publishing
  • Literature reviews — quickly gather papers for systematic reviews
  • Data pipelines — feed structured paper data into analysis tools

Input

FieldTypeRequiredDescription
searchQuerystringSearch terms (e.g. "large language models", "attention mechanism")
categorystringarXiv category filter (e.g. "cs.AI", "cs.LG", "stat.ML")
dateFromstringPapers published on or after (YYYY-MM-DD)
dateTostringPapers published on or before (YYYY-MM-DD)
maxResultsintegerMax papers to return (default: 50, max: 1000)

Output

Each paper in the dataset contains:

{
"title": "Attention Is All You Need",
"abstract": "The dominant sequence transduction models...",
"authors": ["Ashish Vaswani", "Noam Shazeer", "Niki Parmar"],
"publishedDate": "2017-06-12",
"updatedDate": "2023-08-02",
"arxivId": "1706.03762",
"pdfUrl": "https://arxiv.org/pdf/1706.03762",
"absUrl": "https://arxiv.org/abs/1706.03762",
"categories": ["cs.CL", "cs.AI"],
"doi": "10.48550/arXiv.1706.03762"
}
CategoryField
cs.AIArtificial Intelligence
cs.LGMachine Learning
cs.CLComputation and Language (NLP)
cs.CVComputer Vision
cs.RORobotics
stat.MLMachine Learning (Statistics)
physics.comp-phComputational Physics
math.OCOptimization and Control

Example Queries

{"searchQuery": "large language models", "category": "cs.CL", "maxResults": 100}
{"searchQuery": "diffusion models", "category": "cs.CV", "dateFrom": "2024-01-01"}
{"searchQuery": "reinforcement learning", "maxResults": 50}
{"category": "stat.ML", "maxResults": 200}

Notes

  • arXiv API has rate limits — this actor automatically handles throttling with backoff
  • Results are sorted by submission date (newest first)
  • Date filtering is applied client-side after fetching
  • The actor supports arXiv's full query syntax in searchQuery (e.g. ti:attention AND ti:mechanism)

Pricing

Pay-per-event: $1.00 per 1,000 papers returned.