arXiv Papers Scraper — Search Research Papers by Topic & Author
Under maintenancePricing
from $0.70 / 1,000 result items
Search arXiv for research papers by keywords, author, category and date; returns title, authors, abstract, categories, published/updated dates, PDF and abstract URLs, DOI. Sort by relevance or date. Built for research agents. No API key.
search queries the whole arXiv archive through the export API (keywords, authors, dates, ids, sorting) — that API is rate-limited and sometimes throttles for minutes. latest returns the papers in the current daily announcement for categories from arXiv's RSS feed (fast, not rate-limited); query, authors, excludeCategories and announceTypes are applied locally. On weekends/holidays the most recent announcement is returned.
Only in mode latest: keep only these announcement types. new = first-time submissions, cross = new papers cross-listed from another category, replace / replace-cross = new versions of older papers. Empty = all.
Keywords to search (all words must match unless matchMode says otherwise; whole-word match, no stemming). You can also paste raw arXiv query syntax — field prefixes ti: (title), abs: (abstract), au: (author), co: (comment), jr: (journal ref), cat: (category), rn: (report number), all:, with AND / OR / ANDNOT and parentheses, e.g. au:Vaswani AND ti:attention. Raw syntax is passed through unchanged. Leave empty to browse by authors/categories/dates or fetch idList. In mode latest plain keywords are matched locally (whole words, case-insensitive).
Which arXiv field the plain-keyword query is matched against. Ignored when the query already uses field prefixes.
How multiple plain keywords are combined. phrase wraps the query in quotes for an exact phrase match.
One arXiv category code, e.g. cs.AI, q-fin.TR, or an archive like cs (= all cs.*). Kept for backward compatibility — prefer categories.
Required for mode latest. arXiv category codes, paper matches if it is in ANY of them (cross-listings count). Case-insensitive; archive names (cs, q-fin) expand to all their subcategories. Full list of ~155 codes in the README Reference section. Unknown codes are passed through with a warning.
Drop papers filed in any of these categories (ANDNOT cat:…).
Earliest original submission date (v1), inclusive. YYYY-MM-DD (also YYYY-MM, YYYY or ISO datetime). Use with sortBy=submittedDate to monitor new papers.
Latest original submission date, inclusive (end of that day, GMT).
Fetch specific papers by id: 2301.00001, 2301.00001v2, arXiv:…, https://arxiv.org/abs/… or old-style hep-th/9901001. Can be combined with a query (then only ids matching the query are returned).
arXiv server-side sort.
Stop after this many papers. A busy category announces 200–600 papers a day, so raise this for a full latest digest. In search mode pages of 100 are fetched with a polite 3 s pause (arXiv rule), so 1000 papers take ~40 s. Alias: maxItems.
Skip the first N results (manual paging across runs).
Set false for a compact metadata-only dataset.
Truncate abstracts to this length (0 = full abstract).
