arXiv Papers Scraper
Pricing
Pay per usage
Go to Apify Store

arXiv Papers Scraper
Search and fetch academic papers from arXiv.org — filter by category, date range, and author. Returns structured metadata with PDF links.
Pricing
Pay per usage
Rating
0.0
(0)
Developer
Chris Wakefield
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
20 hours ago
Last modified
Categories
Share

arXiv Papers Scraper
Search and fetch academic papers from arXiv.org — the premier open-access repository for physics, mathematics, computer science, and more.
Features
- 🔍 Full-text search across 2.4M+ papers
- 📂 Category filtering — cs.AI, cs.LG, stat.ML, physics., math., and more
- 📅 Date range filtering — papers published between specific dates
- 📊 Structured JSON output — title, authors, abstract, categories, DOI, PDF/ABS URLs
- 🔄 Pagination support — fetch up to 1,000 results per run
- 🆓 No API key required — uses the free arXiv API
Use Cases
- AI/ML researchers — track latest papers on transformers, LLMs, diffusion models
- Academic institutions — monitor publications by department or topic
- Competitive intelligence — track what competitors are publishing
- Literature reviews — quickly gather papers for systematic reviews
- Data pipelines — feed structured paper data into analysis tools
Input
| Field | Type | Required | Description |
|---|---|---|---|
searchQuery | string | ✅ | Search terms (e.g. "large language models", "attention mechanism") |
category | string | arXiv category filter (e.g. "cs.AI", "cs.LG", "stat.ML") | |
dateFrom | string | Papers published on or after (YYYY-MM-DD) | |
dateTo | string | Papers published on or before (YYYY-MM-DD) | |
maxResults | integer | Max papers to return (default: 50, max: 1000) |
Output
Each paper in the dataset contains:
{"title": "Attention Is All You Need","abstract": "The dominant sequence transduction models...","authors": ["Ashish Vaswani", "Noam Shazeer", "Niki Parmar"],"publishedDate": "2017-06-12","updatedDate": "2023-08-02","arxivId": "1706.03762","pdfUrl": "https://arxiv.org/pdf/1706.03762","absUrl": "https://arxiv.org/abs/1706.03762","categories": ["cs.CL", "cs.AI"],"doi": "10.48550/arXiv.1706.03762"}
Popular arXiv Categories
| Category | Field |
|---|---|
cs.AI | Artificial Intelligence |
cs.LG | Machine Learning |
cs.CL | Computation and Language (NLP) |
cs.CV | Computer Vision |
cs.RO | Robotics |
stat.ML | Machine Learning (Statistics) |
physics.comp-ph | Computational Physics |
math.OC | Optimization and Control |
Example Queries
{"searchQuery": "large language models", "category": "cs.CL", "maxResults": 100}{"searchQuery": "diffusion models", "category": "cs.CV", "dateFrom": "2024-01-01"}{"searchQuery": "reinforcement learning", "maxResults": 50}{"category": "stat.ML", "maxResults": 200}
Notes
- arXiv API has rate limits — this actor automatically handles throttling with backoff
- Results are sorted by submission date (newest first)
- Date filtering is applied client-side after fetching
- The actor supports arXiv's full query syntax in
searchQuery(e.g.ti:attention AND ti:mechanism)
Pricing
Pay-per-event: $1.00 per 1,000 papers returned.