arXiv Scraper - Papers, Abstracts & Authors

What is arXiv Scraper?

arXiv Scraper is a tool that lets you scrape research papers from arXiv: title, full abstract, authors with affiliations, categories, submission and update dates, and links to the abstract page and the PDF. Type a keyword or pick arXiv categories, click Start, and download the papers as Excel, CSV or JSON.

• 🔎 Search your way: free-text search, arXiv category codes such as cs.AI, and a date range (last week, month, year or your own dates)
• 👥 Authors as rows: every author can also come as a separate row, linked to the paper
• 🔓 No login: no arXiv account or API key needed
• 💸 Free to try: the $5 of free usage every Apify account gets each month covers about 10,000 papers

What can arXiv Scraper do?

• Scrape arXiv papers by keyword
• Scrape new arXiv papers in a category, such as cs.AI, cs.LG or math.ST
• Get arXiv papers from the last week, month or year, or between two dates
• Export arXiv abstracts to Excel or CSV
• Get arXiv PDF links for every paper
• Get arXiv author lists with affiliations, one row per author
• Sort arXiv results by relevance, submission date or last update
• Export to Excel, CSV, JSON, HTML or XML, or send the data to Google Sheets, Make, Zapier and more

What data can you extract from arXiv papers?

📄 Title	📝 Full abstract	🆔 arXiv ID
🔗 Abstract page URL	📥 PDF URL	🏷️ Categories
⭐ Primary category	📅 Submission date	🔄 Last update date
👥 Author names	🏛️ Author affiliations	🔁 Paper title on every author row

How to scrape arXiv papers

1. Create a free Apify account (no credit card needed).
2. Open arXiv Scraper.
3. Type a Search Query such as large language models, or add Categories such as cs.CL.
4. Pick a Date Range, Sort By and Maximum Results, and click Start.
5. When the run finishes, download your papers and authors as Excel, CSV, JSON, HTML or XML.

How much does it cost to scrape arXiv papers?

From 15 October 2026 you pay $0.50 per 1,000 papers and $0.50 per 1,000 author rows, on every Apify plan. Apify platform usage is included in these prices, so there is nothing else to pay for the run. Until then, see the Pricing tab for the current terms.

Author rows are only produced when Extract Authors is on. For example, from 15 October 2026, 1,000 papers cost $0.50 on the Free plan with Extract Authors off. With it on, 100 papers with 5 authors each give 100 paper rows and 500 author rows, which cost $0.05 + $0.25 = $0.30.

Every Apify account gets $5 of free usage each month. See the Pricing tab for details.

⬇️ Input

Setting	What it does
Search Query	Free-text arXiv search, e.g. machine learning or cat:cs.AI
Categories	arXiv category codes, e.g. cs.AI, cs.LG. Returns papers in any of them
Date Range	lastWeek, lastMonth, lastYear, or your own range as YYYY-MM-DD TO YYYY-MM-DD
Maximum Results	How many papers to return (default 100, up to 500)
Extract Authors	Also output each author as a separate row (on by default)
Extract Abstract	Include the abstract of each paper (on by default)
Sort By	relevance, lastUpdatedDate or submittedDate
Sort Order	ascending or descending

Example: the newest language-model papers of the last month.

{
  "searchQuery": "large language models",
  "categories": ["cs.CL", "cs.AI"],
  "dateRange": "lastMonth",
  "maxResults": 50,
  "extractAuthors": true,
  "sortBy": "submittedDate",
  "sortOrder": "descending"
}

Example: reinforcement learning papers in machine learning from September 2026, papers only.

{
  "searchQuery": "reinforcement learning",
  "categories": ["cs.LG"],
  "dateRange": "2026-09-01 TO 2026-09-30",
  "maxResults": 500,
  "extractAuthors": false,
  "sortBy": "submittedDate"
}

⬆️ Output

You get one row per paper, plus one row per author when Extract Authors is on. The type field tells them apart (paper or author), and each author row carries the arxivId and paperTitle of its paper. You can view the rows as a table in Apify Console or download them as Excel, CSV, JSON, HTML or XML.

A paper row:

{
  "type": "paper",
  "arxivId": "2501.05032v2",
  "url": "http://arxiv.org/abs/2501.05032v2",
  "pdfUrl": "https://arxiv.org/pdf/2501.05032v2",
  "title": "Enhancing Human-Like Responses in Large Language Models",
  "abstract": "This paper explores the advancements in making large language models (LLMs) more human-like. We focus on techniques that enhance natural language understanding, conversational coherence, and emotional intelligence in AI systems. The study evaluates various approaches, including fine-tuning with diverse datasets, incorporating psychological principles, and designing models that better mimic human reasoning patterns. Our findings demonstrate that these enhancements not only improve user interactions but also open new possibilities for AI applications across different domains. Future work will address the ethical implications and potential biases introduced by these human-like attributes.",
  "publishedAt": "2025-01-09T07:44:06Z",
  "updatedAt": "2026-02-01T13:32:03Z",
  "authors": [
    { "name": "Ethem Yağız Çalık", "affiliation": "" },
    { "name": "Talha Rüzgar Akkuş", "affiliation": "" }
  ],
  "categories": ["cs.CL", "cs.AI"],
  "primaryCategory": "cs.CL"
}

An author row from the same paper:

{
  "type": "author",
  "arxivId": "2501.05032v2",
  "paperTitle": "Enhancing Human-Like Responses in Large Language Models",
  "name": "Ethem Yağız Çalık",
  "affiliation": ""
}

Paper fields

Field	Description
type	paper
arxivId	arXiv identifier
url	arXiv abstract page URL
pdfUrl	Direct PDF URL
title	Paper title
abstract	Paper abstract
publishedAt	Submission date and time (ISO 8601)
updatedAt	Last update date and time (ISO 8601)
authors	List of {name, affiliation} objects
categories	arXiv category codes
primaryCategory	Primary arXiv category

Author fields

Field	Description
type	author
arxivId	arXiv ID of the paper
paperTitle	Title of the paper
name	Author name
affiliation	Author affiliation, when given

How can I use arXiv data?

• Research monitoring: track new papers in your field or on your keywords every week
• Literature reviews: collect abstracts, authors and categories for a systematic review
• Academic lead generation: build lists of researchers by topic
• Trend analysis: count papers per category or keyword over time
• Search and AI apps: feed abstracts and metadata into your own semantic search or reading list

How to monitor new arXiv papers

1. Set Date Range to lastWeek, Sort By to submittedDate and Sort Order to descending.
2. Add your Search Query or Categories.
3. Schedule the actor to run every week, and send the new papers to Slack, email or a spreadsheet with an integration.

Scrape more research and knowledge data

Actor	What it gets
Wikidata Scraper - Entities, Labels & Descriptions	Wikidata entities with labels, descriptions, aliases and Wikipedia links
GitHub Repository Scraper - Repos, Issues & Pull Requests	Repository details, issues, pull requests and contributors, for the code behind papers
Hacker News Scraper - Stories, Comments & Trends	Hacker News stories and discussions by keyword, points and date
Google News Scraper - Full Article Text, Alerts & RSS	Google News articles by keyword with full text, only new ones on every run
Federal Register Scraper - Notices, Rules & Agencies	Federal Register notices with dates, agencies and PDF links

❓FAQ

How much does arXiv Scraper cost?

From 15 October 2026 it costs $0.50 per 1,000 papers and $0.50 per 1,000 author rows, with platform usage included. See the cost section above and the Pricing tab.

Do I need an arXiv account?

No. arXiv papers are open, so you need no account, login or API key.

How many papers can I get per run?

Up to 500 papers per run. Very large searches take a little longer. For more, split the search by date range or category.

Can I download the full PDF?

The actor returns a direct PDF link in the pdfUrl field for every paper. You can download the PDFs from those links.

Why are author affiliations empty?

arXiv only has an affiliation when the submitter added one, and many papers have none. The affiliation field is empty in those cases.

What categories are available?

arXiv uses codes such as cs.AI (Artificial Intelligence), cs.LG (Machine Learning), cs.CL (Computation and Language), physics.gen-ph and math.ST. See the full list on arxiv.org.

How recent is the data?

The data reflects the arXiv index at the time of the run.

Can I connect arXiv Scraper to other tools or AI agents?

Yes. Start runs and download results with the Apify API or the Python and JavaScript clients, send results to Make, Zapier, n8n, Google Sheets or Slack with Apify integrations and webhooks, or let AI assistants and agents run it through the Apify MCP server at mcp.apify.com.

Is it legal to scrape arXiv?

This actor only collects public paper details that anyone can read on arXiv. Author names and affiliations are still personal data, which may be protected by laws such as GDPR, and each paper's text is covered by its license. Only use the data for a legitimate reason and ask a lawyer if you are unsure. You can read more in Is web scraping legal?

arXiv Scraper is an independent tool. It is not affiliated with, endorsed by or sponsored by arXiv.

Something isn't working?

Open the Issues tab and tell us your input and what you expected.

⭐ Your feedback

Have an idea or found a problem? Tell us on the Issues tab. If arXiv Scraper saved you time, a short review on the Reviews tab helps other people find it.