arXiv Academic Paper Scraper

Extract academic papers from arXiv.org using the public API. Search by keywords, categories, or authors. Get titles, abstracts, authors, PDF links, DOIs, and publication dates.

Features

• Keyword search: Search arXiv by any query term
• Category search: Filter by arXiv categories (e.g., cat:cs.AI, cat:physics, cat:math.ST)
• Author search: Find papers by specific authors (e.g., au:Hinton)
• Rich metadata: Titles, abstracts, authors, DOIs, journal references, comments
• PDF links: Direct PDF download URLs for every paper
• Category data: Primary category and all category tags
• No API key required: Uses arXiv's free public API
• Sorting: By relevance, submission date, or last updated date

Input Parameters

Parameter	Type	Default	Description
searchQueries	string[]	[]	List of search queries (leave empty to use categories only)
categories	string[]	["cs.AI"]	arXiv categories to scrape (e.g. cs.AI, cs.CL, cs.LG, stat.ML, quant-ph)
maxResults	integer	100	Max papers per query or category (100 per page)
sortBy	select	submittedDate	Sort by: relevance, submittedDate, lastUpdatedDate
sortOrder	select	descending	ascending or descending

Search Query Syntax

arXiv supports a powerful query syntax:

• Category: cat:cs.AI (AI papers), cat:cs.CL (NLP), cat:cs.CV (computer vision)
• Author: au:Hinton or au:"Yann LeCun"
• Title: ti:transformer or ti:"neural network"
• Abstract: abs:attention or abs:"large language model"
• All fields: all:quantum (searches title, abstract, and authors)
• Combined: cat:cs.AI AND ti:transformer or cat:cs.CL AND au:Hinton

Popular arXiv Categories

Computer Science (cs.*)

• cs.AI — Artificial Intelligence
• cs.AR — Hardware Architecture
• cs.CL — Computation and Language (NLP)
• cs.CV — Computer Vision and Pattern Recognition
• cs.DB — Databases
• cs.DC — Distributed Computing
• cs.DS — Data Structures and Algorithms
• cs.IR — Information Retrieval
• cs.IT — Information Theory
• cs.LG — Machine Learning
• cs.LO — Logic in Computer Science
• cs.NE — Neural and Evolutionary Computing
• cs.OS — Operating Systems
• cs.PL — Programming Languages
• cs.RO — Robotics
• cs.SE — Software Engineering
• cs.SD — Sound
• cs.SY — Systems and Control

Statistics (stat.*)

• stat.ML — Machine Learning (Statistics)
• stat.AP — Applications
• stat.CO — Computation
• stat.ME — Methodology

Electrical Engineering (eess.*)

• eess.AS — Audio and Speech Processing
• eess.IV — Image and Video Processing
• eess.SP — Signal Processing

Mathematics (math.*)

• math.AG — Algebraic Geometry
• math.AP — Analysis of PDEs
• math.CO — Combinatorics
• math.DG — Differential Geometry
• math.DS — Dynamical Systems
• math.FA — Functional Analysis
• math.NT — Number Theory
• math.PR — Probability
• math.QA — Quantum Algebra
• math.ST — Statistics Theory

Physics (physics.*)

• physics.optics — Optics
• physics.flu-dyn — Fluid Dynamics
• physics.med-ph — Medical Physics
• physics.bio-ph — Biological Physics
• physics.chem-ph — Chemical Physics

Other

• quant-ph — Quantum Physics
• q-bio.* — Quantitative Biology
• q-fin.* — Quantitative Finance
• cond-mat — Condensed Matter
• astro-ph — Astrophysics
• hep-th — High Energy Physics (Theory)
• hep-ex — High Energy Physics (Experimental)

Output Fields

• arxivId — arXiv paper ID (e.g., 2608.09930v1)
• title — Paper title
• authors — List of author names
• abstract — Full abstract text
• publishedDate — Publication date (ISO format)
• updatedDate — Last updated date
• arxivUrl — arXiv abstract page URL
• pdfUrl — Direct PDF download URL
• doi — DOI (if available)
• comment — Author comments (e.g., "Accepted at ICML 2026")
• primaryCategory — Primary arXiv category
• categories — All category tags
• journalRef — Journal reference (if published)
• searchQuery — The query that found this paper

Use Cases

• Academic research and literature reviews
• AI/ML paper monitoring (get latest papers daily)
• Author publication tracking
• Trend analysis in research fields
• AI training data from paper abstracts
• Competitive intelligence for research labs

Related Actors

• FinViz Stock Screener Scraper — Financial data extraction
• Google Maps Lead Intelligence — B2B lead generation

Notes

• arXiv requests 3-second delays between API calls. This actor respects that.
• Maximum 2000 results per query (arXiv API limit).
• Results are sorted by submission date by default (newest first).