arXiv Paper Scraper: Search, Daily New Papers & Full Text
Pricing
from $2.00 / 1,000 results
arXiv Paper Scraper: Search, Daily New Papers & Full Text
Search arXiv by keyword, category, author and date, get today's new papers, or look up papers by id: title, authors, abstract, categories, dates, PDF, plus Hugging Face upvotes, GitHub repo and stars, AI summary, and the full text split into sections for RAG.
Pricing
from $2.00 / 1,000 results
Rating
0.0
(0)
Developer
Sheshinmcfly
Maintained by CommunityActor stats
1
Bookmarked
4
Total users
0
Monthly active users
17 days ago
Last modified
Categories
Features
Share
Get papers from arXiv in a clean, structured format: search by keyword, category, author and submission date, browse the newest papers in any category, get today's new papers (the daily announcement), or look up papers by id or URL. Each paper comes with title, authors, abstract, categories, dates, version, DOIs and PDF/HTML links, plus Hugging Face signals (community upvotes, GitHub repo and stars, AI summary and keywords, linked models and datasets) and, optionally, the full text split into sections, ready for RAG and LLM pipelines. Schedule it with only new papers for a daily research feed.
What data do you get?
| Field | Example |
|---|---|
arxivId, version | 2312.00752, 2 |
title, authors | Mamba: Linear-Time Sequence Modeling…, Albert Gu, Tri Dao |
abstract | full abstract |
primaryCategory, categories | cs.LG, cs.LG, cs.AI |
publishedDate, updatedDate | 2023-12-01, 2024-05-31 |
comments, journalRef, doi, arxivDoi | 32 pages, 22 figures, 10.48550/arXiv.2312.00752 |
url, pdfUrl, htmlUrl | abstract page, PDF and HTML version |
hfUpvotes, githubRepo, githubStars | 152, github.com/state-spaces/mamba, 18971 |
aiSummary, aiKeywords | one-sentence summary and topic keywords |
linkedModels, linkedDatasets, linkedSpaces | 96, 3, 23 |
announceType | daily listing: new, cross or replace |
With "Include full text": fullTextSections (each section's title and text), fullTextChars, referenceCount, figureCount, tableCount.
With your Semantic Scholar API key (free): citationCount, influentialCitationCount, tldr, venue.
How to use
- Choose what to get: Keyword search, Newest in categories, Today's new papers or Papers by id
- Add search queries, categories (
cs.AI,cs.LG,cs.CL,stat.ML…), authors or paper ids, or paste arXiv URLs - Optionally set a submission date range and turn on full text
- Click Start. For a daily feed, schedule Today's new papers or a search with Only papers not returned before
Use cases
- Research monitoring: a daily feed of new papers in your fields
- RAG & LLM pipelines: abstracts and full text split into sections, with clean metadata
- Trend & impact tracking: which papers the community upvotes and which have code and stars
- Literature reviews: search by topic, author and period in one run
- Dataset building: thousands of papers per category with consistent fields
Input
{"mode": "search","queries": ["\"mixture of experts\" routing"],"categories": ["cs.LG", "cs.CL"],"dateFrom": "2026-01","maxResults": 200,"includeFullText": true}
| Parameter | Type | Default | Description |
|---|---|---|---|
mode | string | search | search, category, new (today's listing) or id |
queries | array | — | Keywords; quotes for exact phrases |
searchField | string | all | all, title, abstract, author |
categories | array | — | arXiv categories |
authors | array | — | Only papers by these authors |
idList | array | — | arXiv ids or links |
urls | array | — | arXiv paper, listing or search URLs |
dateFrom, dateTo | string | — | Submission date range (YYYY, YYYY-MM or YYYY-MM-DD) |
sortBy, sortOrder | string | — | relevance, submittedDate, lastUpdatedDate; descending / ascending |
newTypes | array | new, cross | Daily listing: new submissions, cross-listings, replacements |
maxResults | integer | 50 | Papers per search, category or listing |
includeHuggingFace | boolean | true | Upvotes, GitHub repo and stars, AI summary, linked models |
includeFullText | boolean | false | Full text in sections |
semanticScholarApiKey | string | — | Your free key, for citation counts |
onlyNew | boolean | false | Only papers not returned by previous runs of the same search |
Example output
{"arxivId": "2312.00752","version": 2,"title": "Mamba: Linear-Time Sequence Modeling with Selective State Spaces","authors": ["Albert Gu", "Tri Dao"],"abstract": "Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the …","primaryCategory": "cs.LG","categories": ["cs.LG", "cs.AI"],"publishedDate": "2023-12-01T18:01:34Z","updatedDate": "2024-05-31T17:55:27Z","arxivDoi": "10.48550/arXiv.2312.00752","url": "https://arxiv.org/abs/2312.00752","pdfUrl": "https://arxiv.org/pdf/2312.00752","hfUpvotes": 152,"githubRepo": "https://github.com/state-spaces/mamba","githubStars": 18971,"aiSummary": "Mamba, a novel SSM-based model, outperforms Transformers in inference speed and scalability across various modalities…","aiKeywords": ["Transformer architecture", "attention module", "linear attention"],"linkedModels": 96,"linkedDatasets": 3,"linkedSpaces": 23,"hfUrl": "https://huggingface.co/papers/2312.00752"}
Performance
- 50 papers with Hugging Face signals in about 8 seconds
- 300 papers from a category in about 12 seconds
- Today's new papers in a category in about 7 seconds
- Full text: about 1 second per paper
Pricing
Pay-per-event: $0.002 per paper returned.
| Papers | Cost |
|---|---|
| 100 | $0.20 |
| 1,000 | $2.00 |
| 10,000 | $20.00 |
Every Apify account gets $5 in free usage per month.
FAQ
Which papers have full text?
Papers with an HTML version on arXiv, which covers most papers submitted since late 2023. Others return hasFullText: false.
Why are Hugging Face fields empty for some papers? They are filled for papers that appear on Hugging Face (most AI/ML papers that people share). Other papers keep these fields empty.
How do I get citation counts? Add your free Semantic Scholar API key. The keyless Semantic Scholar service is shared and usually over capacity, so citations are only added with a key.
How does "Today's new papers" work? It returns the papers arXiv announced today for the chosen categories: new submissions and cross-listings by default, optionally replacements.
Keywords
arxiv scraper, arxiv api, arxiv papers, research papers, academic papers, daily arxiv, new arxiv papers, paper full text, rag dataset, hugging face papers, github stars papers, literature review
More actors
Browse all my scrapers on my Apify profile.
Changelog
- v2.0 (2026-11-04): today's new papers mode; author and server-side date filters; paper ids and arXiv URLs; Hugging Face signals (upvotes, GitHub repo and stars, AI summary and keywords, linked models/datasets/spaces); optional full text in sections; citations with your Semantic Scholar key; only-new mode; version and arXiv DOI; faster.
- v1.0 (2026-04-21): keyword search, category browse and id lookup.