Pricing

from $1.50 / 1,000 results

Try for free

Go to Apify Store

arXiv AI & ML Research Papers Scraper — Preprints & RAG

Try for free

Scrape latest AI, ML, Computer Science, and Quantitative research papers from arXiv with full abstracts, authors, categories, and direct PDF URLs.

Pricing

from $1.50 / 1,000 results

Rating

0.0

(0)

Developer

Axery

Actor stats

Bookmarked

Total users

Monthly active users

5 days ago

Last modified

arXiv AI & ML Research Papers Scraper

Scrape the latest preprint research papers from arXiv.org across AI, Machine Learning, NLP, Computer Vision, Robotics, and Quantitative Finance — designed for RAG pipelines, vector embedding databases, AI newsletters, and academic knowledge retrieval.

Pure HTTP via official arXiv Atom API. No browser overhead. Fast, lightweight, and reliable.

⚡ What makes this different for AI builders

Direct Vector Embedding Ready: Complete abstracts cleaned from linebreaks, ready to pass into embedding models (text-embedding-3, bge-large, etc.).
Direct PDF Links: Direct canonical PDF download links (https://arxiv.org/pdf/...).
Comprehensive Metadata: Extracts primaryCategory, allCategories, authors, doi, journalRef, publishedDate, and updatedDate.
Zero Captchas: Uses arXiv's official query protocol with automatic retry logic and backoff.

📥 Input Parameters

{
  "category": "cs.AI",
  "query": "large language models",
  "sortBy": "submittedDate",
  "maxItems": 50
}

Field	Type	Default	Description
`category`	string	`cs.AI`	Primary subject: `cs.AI`, `cs.LG`, `cs.CL` (NLP/LLMs), `cs.CV`, `stat.ML`, `q-fin.ST`, etc.
`query`	string	`null`	Optional keyword search across titles and abstracts.
`sortBy`	string	`submittedDate`	`submittedDate` (Newest first), `lastUpdatedDate`, or `relevance`.
`sortOrder`	string	`descending`	`descending` or `ascending`.
`maxItems`	integer	`50`	Maximum number of papers to extract.

📤 Output Structure

Each paper in the dataset is a clean, typed JSON object:

{
  "arxivId": "2310.12345v1",
  "title": "A Survey on Large Language Model Based Autonomous Agents",
  "abstract": "Autonomous agents have long been a prominent research focus...",
  "authors": ["Lei Wang", "Chen Ma", "Xueyang Feng", "Zeyu Zhang"],
  "primaryCategory": "cs.AI",
  "allCategories": ["cs.AI", "cs.CL", "cs.MA"],
  "publishedDate": "2023-10-18T17:58:32Z",
  "updatedDate": "2023-10-18T17:58:32Z",
  "pdfUrl": "https://arxiv.org/pdf/2310.12345v1",
  "absUrl": "https://arxiv.org/abs/2310.12345v1",
  "doi": null,
  "comment": "38 pages, 10 figures"
}

arXiv Scraper

bgfc97/arxiv-scraper

Scrape research papers from arXiv — title, authors, abstract, categories, DOI, journal reference, PDF link, published/updated dates — by search query, category, or arXiv ID. Official Atom API, no key, no proxy.

Bruno

ArXiv Paper Search MCP

reverberant_equality/mcp-arxiv-search

Search ArXiv papers and retrieve paper details. AI agents can discover academic research, abstracts, authors, categories, and PDF links.

Jordan C

ArXiv AI Research Scraper – ML Preprints & Direct PDF API

robinworld/arxiv-ai-research-breakout-tracker

Scrapes real-time computer science and machine learning research papers (cs.AI, cs.LG, cs.CL) from Cornell arXiv with abstracts and direct PDF links.

Robin world

arXiv Papers Scraper - Authors, Abstracts & PDFs

eliai/arxiv-papers-scraper

Search arXiv and get one row per paper: title, full abstract, every author, categories, the bare arXiv id plus its version, a direct PDF link, DOI and journal reference. arXiv query syntax, category filter, bulk searches. $0.01 per paper.

Broke to Built

arXiv Scraper - Papers, Authors & Abstracts

logiover/arxiv-paper-scraper

Scrape arXiv preprints in bulk. Extract paper title, abstract, authors, categories, publication and update dates, abstract page and PDF links from any search query to CSV/JSON. No API key, no login.

Logiover

ArXiv Paper Scraper

alleserojje/arxiv-paper-scraper

Search arXiv and export structured paper metadata — title, authors, abstract, categories, DOI, PDF link — via the official arXiv API. No key, no anti-bot. Pay per paper.

Pedro Resende

arXiv Scraper & API - Papers by Category, Keyword, Author, Date

neverempty/arxiv-scraper

arXiv papers from the official arXiv API as flat rows: ID, version, title, abstract, authors, categories, dates, DOI, journal ref and abs/PDF links. Search by keyword, title, author, category or date range, look up IDs in bulk, or monitor a category for new papers. PDFs are linked, never copied.

NeverEmpty

arXiv Scraper API - Research Paper Search & Preprints

pink_comic/arxiv-paper-search

Search authoritative arXiv preprint metadata by title, abstract, all fields, author, category, ID, submitted/updated date ranges, sorting, and pagination. Return normalized IDs, authors, categories, abstracts, journal references, DOIs, canonical abstracts, and PDF links.

Ava Torres

📄 arXiv Daily AI & Machine Learning Research Papers Feed

unrivaled_fortress/arxiv-cs-ai-papers-daily-feed

Extract daily computer science, generative AI, and machine learning research paper preprints, abstracts, and author lists from arXiv RSS feed.

David A

arXiv Scraper — papers by search, category or ID

vincentkirui/arxiv-scraper

Structured arXiv papers via the official open API (no key): search by keyword/author/category, pull the latest in a subject (cs.AI, cs.LG, ...), or fetch papers by ID. Clean JSON — built for AI/RAG research pipelines.