arXiv Paper Scraper: Search, Daily New Papers & Full Text avatar

arXiv Paper Scraper: Search, Daily New Papers & Full Text

Pricing

from $2.00 / 1,000 results

Go to Apify Store
arXiv Paper Scraper: Search, Daily New Papers & Full Text

arXiv Paper Scraper: Search, Daily New Papers & Full Text

Search arXiv by keyword, category, author and date, get today's new papers, or look up papers by id: title, authors, abstract, categories, dates, PDF, plus Hugging Face upvotes, GitHub repo and stars, AI summary, and the full text split into sections for RAG.

Pricing

from $2.00 / 1,000 results

Rating

0.0

(0)

Developer

Sheshinmcfly

Sheshinmcfly

Maintained by Community

Actor stats

1

Bookmarked

4

Total users

0

Monthly active users

17 days ago

Last modified

Features

Limited permissions

Share

Get papers from arXiv in a clean, structured format: search by keyword, category, author and submission date, browse the newest papers in any category, get today's new papers (the daily announcement), or look up papers by id or URL. Each paper comes with title, authors, abstract, categories, dates, version, DOIs and PDF/HTML links, plus Hugging Face signals (community upvotes, GitHub repo and stars, AI summary and keywords, linked models and datasets) and, optionally, the full text split into sections, ready for RAG and LLM pipelines. Schedule it with only new papers for a daily research feed.

What data do you get?

FieldExample
arxivId, version2312.00752, 2
title, authorsMamba: Linear-Time Sequence Modeling…, Albert Gu, Tri Dao
abstractfull abstract
primaryCategory, categoriescs.LG, cs.LG, cs.AI
publishedDate, updatedDate2023-12-01, 2024-05-31
comments, journalRef, doi, arxivDoi32 pages, 22 figures, 10.48550/arXiv.2312.00752
url, pdfUrl, htmlUrlabstract page, PDF and HTML version
hfUpvotes, githubRepo, githubStars152, github.com/state-spaces/mamba, 18971
aiSummary, aiKeywordsone-sentence summary and topic keywords
linkedModels, linkedDatasets, linkedSpaces96, 3, 23
announceTypedaily listing: new, cross or replace

With "Include full text": fullTextSections (each section's title and text), fullTextChars, referenceCount, figureCount, tableCount.

With your Semantic Scholar API key (free): citationCount, influentialCitationCount, tldr, venue.

How to use

  1. Choose what to get: Keyword search, Newest in categories, Today's new papers or Papers by id
  2. Add search queries, categories (cs.AI, cs.LG, cs.CL, stat.ML…), authors or paper ids, or paste arXiv URLs
  3. Optionally set a submission date range and turn on full text
  4. Click Start. For a daily feed, schedule Today's new papers or a search with Only papers not returned before

Use cases

  • Research monitoring: a daily feed of new papers in your fields
  • RAG & LLM pipelines: abstracts and full text split into sections, with clean metadata
  • Trend & impact tracking: which papers the community upvotes and which have code and stars
  • Literature reviews: search by topic, author and period in one run
  • Dataset building: thousands of papers per category with consistent fields

Input

{
"mode": "search",
"queries": ["\"mixture of experts\" routing"],
"categories": ["cs.LG", "cs.CL"],
"dateFrom": "2026-01",
"maxResults": 200,
"includeFullText": true
}
ParameterTypeDefaultDescription
modestringsearchsearch, category, new (today's listing) or id
queriesarray—Keywords; quotes for exact phrases
searchFieldstringallall, title, abstract, author
categoriesarray—arXiv categories
authorsarray—Only papers by these authors
idListarray—arXiv ids or links
urlsarray—arXiv paper, listing or search URLs
dateFrom, dateTostring—Submission date range (YYYY, YYYY-MM or YYYY-MM-DD)
sortBy, sortOrderstring—relevance, submittedDate, lastUpdatedDate; descending / ascending
newTypesarraynew, crossDaily listing: new submissions, cross-listings, replacements
maxResultsinteger50Papers per search, category or listing
includeHuggingFacebooleantrueUpvotes, GitHub repo and stars, AI summary, linked models
includeFullTextbooleanfalseFull text in sections
semanticScholarApiKeystring—Your free key, for citation counts
onlyNewbooleanfalseOnly papers not returned by previous runs of the same search

Example output

{
"arxivId": "2312.00752",
"version": 2,
"title": "Mamba: Linear-Time Sequence Modeling with Selective State Spaces",
"authors": ["Albert Gu", "Tri Dao"],
"abstract": "Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the …",
"primaryCategory": "cs.LG",
"categories": ["cs.LG", "cs.AI"],
"publishedDate": "2023-12-01T18:01:34Z",
"updatedDate": "2024-05-31T17:55:27Z",
"arxivDoi": "10.48550/arXiv.2312.00752",
"url": "https://arxiv.org/abs/2312.00752",
"pdfUrl": "https://arxiv.org/pdf/2312.00752",
"hfUpvotes": 152,
"githubRepo": "https://github.com/state-spaces/mamba",
"githubStars": 18971,
"aiSummary": "Mamba, a novel SSM-based model, outperforms Transformers in inference speed and scalability across various modalities…",
"aiKeywords": ["Transformer architecture", "attention module", "linear attention"],
"linkedModels": 96,
"linkedDatasets": 3,
"linkedSpaces": 23,
"hfUrl": "https://huggingface.co/papers/2312.00752"
}

Performance

  • 50 papers with Hugging Face signals in about 8 seconds
  • 300 papers from a category in about 12 seconds
  • Today's new papers in a category in about 7 seconds
  • Full text: about 1 second per paper

Pricing

Pay-per-event: $0.002 per paper returned.

PapersCost
100$0.20
1,000$2.00
10,000$20.00

Every Apify account gets $5 in free usage per month.

FAQ

Which papers have full text? Papers with an HTML version on arXiv, which covers most papers submitted since late 2023. Others return hasFullText: false.

Why are Hugging Face fields empty for some papers? They are filled for papers that appear on Hugging Face (most AI/ML papers that people share). Other papers keep these fields empty.

How do I get citation counts? Add your free Semantic Scholar API key. The keyless Semantic Scholar service is shared and usually over capacity, so citations are only added with a key.

How does "Today's new papers" work? It returns the papers arXiv announced today for the chosen categories: new submissions and cross-listings by default, optionally replacements.

Keywords

arxiv scraper, arxiv api, arxiv papers, research papers, academic papers, daily arxiv, new arxiv papers, paper full text, rag dataset, hugging face papers, github stars papers, literature review

More actors

Browse all my scrapers on my Apify profile.

Changelog

  • v2.0 (2026-11-04): today's new papers mode; author and server-side date filters; paper ids and arXiv URLs; Hugging Face signals (upvotes, GitHub repo and stars, AI summary and keywords, linked models/datasets/spaces); optional full text in sections; citations with your Semantic Scholar key; only-new mode; version and arXiv DOI; faster.
  • v1.0 (2026-04-21): keyword search, category browse and id lookup.