Pricing

from $1.00 / 1,000 results

arXiv Search & Paper Scraper

Search arXiv and get clean structured JSON for each paper: title, authors, abstract, categories, DOI, PDF link, and dates. Built for research, datasets, and AI pipelines.

Pricing

from $1.00 / 1,000 results

Rating

0.0

(0)

Developer

Nicolas van Arkens

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

arXiv Search & Paper Scraper 📚

Search arXiv and get clean, structured JSON for every paper — title, authors, abstract, categories, DOI, journal reference, PDF link, and dates. The arXiv API returns awkward Atom XML; this actor does the parsing for you and hands back tidy records ready for analysis, datasets, citation management, or feeding papers to an LLM.

Why use it

🔎 Flexible search — by keywords, author, arXiv category, or title
👥 Authors as a clean list — not a blob of XML
🏷️ Categories split out — primary category plus all cross-listed ones
🔗 Direct PDF + abstract links — and DOI / journal reference when available
📅 Parsed dates — published and last-updated
🧹 Normalized text — abstracts cleaned of the API's messy whitespace
↕️ Sort by relevance, last updated, or submission date

Use cases

Literature reviews & research — pull every recent paper in a field
Building datasets — assemble structured corpora of papers and abstracts
LLM / RAG pipelines — feed clean abstracts and metadata to models
Trend monitoring — track new submissions in a category over time
Citation & reference tooling — grab DOIs and journal refs at scale

Input

Field	Description
Search query	Free-text keywords across all fields.
Author	Restrict to an author (phrase match).
Category	arXiv code, e.g. `cs.LG`, `cs.CL`, `stat.ML`.
Title contains	Restrict by title phrase.
Sort by / order	Relevance, last updated, or submitted; asc/desc.
Maximum papers	How many to return.

Output

{
  "arxivId": "1706.03762v7",
  "version": 7,
  "title": "Attention Is All You Need",
  "summary": "The dominant sequence transduction models are based on...",
  "authors": ["Ashish Vaswani", "Noam Shazeer", "Niki Parmar"],
  "authorCount": 3,
  "primaryCategory": "cs.CL",
  "categories": ["cs.CL", "cs.LG"],
  "published": "2017-06-12T17:57:34Z",
  "updated": "2023-08-02T00:41:18Z",
  "doi": "10.5555/3295222.3295349",
  "journalRef": "NeurIPS 2017",
  "pdfUrl": "http://arxiv.org/pdf/1706.03762v7",
  "absUrl": "http://arxiv.org/abs/1706.03762v7"
}

Export to JSON, CSV, or Excel, or pull via the Apify API. Connect to Sheets, Notion, Slack, Zapier, or Make.

Notes

Uses the official public arXiv API. Independent tool, not affiliated with arXiv or Cornell University.
Please be considerate with large jobs; the actor paces requests to respect arXiv's API guidelines.
arXiv category reference: see arxiv.org/category_taxonomy for the full list of codes.

🎓 Research MCP — AI Paper Search & Citations

nexgendata/academic-research-mcp-server

🎓 Academic research, scholarly papers, arXiv, PubMed, Google Scholar MCP server for AI agents (Claude Desktop, Cursor, OpenAI Agents SDK). Search papers + citations + authors + abstracts via MCP — built for literature-review and research AI workflows. Free tier available.

Stephan Corbeil

📚 Wikipedia Scraper — Articles & Knowledge Data

nexgendata/wikipedia-scraper

Extract structured data from Wikipedia — article text, infoboxes, categories, references & links. Build knowledge bases, AI training datasets & research tools. Pay per article.

Stephan Corbeil

arXiv Papers Scraper

crawlerbros/arxiv-papers-scraper

Scrape academic preprints from arXiv.org by keyword, author, or category. Returns clean records with title, authors, abstract, categories, PDF URL, DOI. HTTP-only via the public arXiv API. No login, no proxy.

Crawler Bros

5.0

(23)

ArXiv Paper Scraper — Search by Category, Bulk JSON, DOI

knotless_cadence/arxiv-paper-scraper

arXiv corpus as JSON — arxivId, title, authors, abstract, categories, dates, DOI, PDF URL. By search OR category. Built for ML/AI training data + lit reviews. 19 runs. Backed by 951-run Trustpilot flagship + 31-actor portfolio. spinov001@gmail.com · blog.spinov.online · t.me/scraping_ai

Alex

arXiv Papers Scraper

devilscrapes/arxiv-papers-scraper

Search arXiv by query, category, or author and get structured paper metadata — title, authors, abstract, primary category, DOI, PDF URL, submitted and updated timestamps. We handle pagination, retries, and rate-limit pacing so you get clean typed rows ready for a research pipeline.

DevilScrapes

ArXiv Paper Scraper

sheshinmcfly/arxiv-paper-scraper

Search and extract scientific papers from ArXiv.org across any field. Returns title, authors, full abstract, PDF link, arXiv ID, categories, and submission date. Ideal for AI research monitoring, RAG pipelines, literature reviews, and academic trend analysis. No API key needed.

Sheshinmcfly

arXiv Data Scraper - Semantic Scholar Alternative

fatihai-tools/arxiv-scraper

Scrape data from arXiv fast. Bulk URL or query input, structured JSON/CSV output, no login required. Free trial — perfect alternative to Semantic Scholar. Use for lead generation, market research, competitive analysis.

fatih dağüstü

arXiv Papers Scraper - AI/ML Research at Scale

wetyr_corporation/arxiv-papers-scraper

Search and bulk extract arXiv research papers with abstracts, authors, categories, and PDF links. Built for AI/ML researchers, RAG knowledge bases, and citation tracking.

WETYR

Arxiv Papers Scraper

chimerical_quicklime/arxiv-papers-scraper

Search arXiv preprints via the public Atom API. Returns title, authors, abstract, categories, published date, updated date, DOI, journal reference, and PDF link. Filter by category, author, or keyword.

Khrystyna Skotte

arXiv Papers Scraper with AI Topic Tags

elder_contrabasson/arxiv-scraper

Search arXiv.org for academic papers by keyword, author, or category. Get clean structured data with optional AI topic tagging via Claude. Perfect for literature reviews, research monitoring, and academic datasets.