Pricing

from $0.70 / 1,000 item scrapeds

Try for free

Go to Apify Store

arXiv AI & Computer Science Research Paper Extractor

Try for free

Search and extract academic scientific papers from ArXiv. Collect titles, authors, full abstracts, PDF links, and research categories for AI and research pipelines.

Pricing

from $0.70 / 1,000 item scrapeds

Rating

0.0

(0)

Developer

LiteZero

Actor stats

Bookmarked

Total users

Monthly active users

6 days ago

Last modified

📄 arXiv AI & Computer Science Research Paper Extractor

Scrape scientific research papers, abstracts, authors, DOI links, primary categories, and direct PDF downloads from arXiv.org for AI research feeds, RAG pipelines, and literature reviews.

🥊 Why This Actor Beats the Competition

Feature	ArXiv HTML Web Scrapers	Manual Research Portals	This Actor
IP Ban Risk	❌ Banned by arXiv strict anti-scraping	N/A	✅ Official OAI-PMH & API compliance
Metadata Quality	⚠️ Messy HTML abstract stripping	⏳ Manual copying	📚 Clean title, abstract, authors & PDF links
Category Filtering	❌ Difficult to filter by sub-discipline	Manual search	🎯 Filter by cs.AI, cs.LG, stat.ML, etc.
Cost	💸 Heavy compute billings	Time cost	💰 $1.00 per 1,000 papers (PPR)

🛠️ Step-by-Step: How to Use

Method 1: Apify Console

Enter your search query in Search Query (e.g. large language models, reinforcement learning).
Optional: Filter by Category (e.g. cs.AI, cs.LG, cs.CV).
Set Max Results limit (default: 50).
Click Start to extract paper metadata and PDF links.

Method 2: Python SDK

from apify_client import ApifyClient

client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("litezero/arxiv-research-paper-scraper").call(run_input={
    "searchQuery": "large language models",
    "category": "cs.AI",
    "maxResults": 20
})

for paper in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(f"[{paper['published']}] {paper['title']}")
    print(f"PDF: {paper['pdfUrl']}
")

📥 Input Parameters

Field	Type	Required	Default	Description
`searchQuery`	String	No	`"large language models"`	Keyword query or author name
`category`	String	No	`"cs.AI"`	Subject category code (`cs.AI`, `cs.LG`, `cs.CL`)
`maxResults`	Integer	No	`50`	Maximum papers to extract

📤 Output Data Dictionary

Field	Type	Description
`id`	String	Unique arXiv paper identifier
`title`	String	Full academic paper title
`summary`	String	Complete abstract text
`authors`	Array	List of author names
`primaryCategory`	String	Primary arXiv subject classification
`published`	String	ISO 8601 publication date
`updated`	String	ISO 8601 latest revision date
`pdfUrl`	String	Direct PDF download link
`arxivUrl`	String	Canonical abstract landing page
`scrapedAt`	String	ISO 8601 extraction timestamp

💡 Top Use Cases

Daily AI Research Monitors: Power automated Slack/Discord channels alerting on new AI papers.
RAG Knowledge Base Seeding: Automatically ingest authoritative domain literature.

ArXiv MCP server

jakub.kopecky/arxiv-mcp-server

The ArXiv MCP server provides a bridge between AI assistants and arXiv's research repository through the Model Context Protocol (MCP). It allows AI models to search for papers and access their content in a programmatic way.

Jakub Kopecký

📚 arXiv Article Metadata Scraper - Pay per results

scrapestorm/arxiv-article-metadata-scraper---pay-per-results

Discover top arXiv papers with ⚡fast metadata extraction! Sort by 🔥 relevance 🕒 submission date or 📚 subject area. Get key info like titles, abstracts, authors, PDF links & more. Perfect for 📊 literature reviews, trend tracking, academic research & building high-quality AI training datasets!

Storm_Scraper

5.0

(1)

arXiv Paper Scraper - Research Papers & Abstracts

viralanalyzer/arxiv-paper-intelligence

Search and extract ArXiv papers, abstracts, authors, and citations. Track research trends across any scientific field. AI-powered analysis.

viralanalyzer

5.0

(4)

arXiv Search Scraper 📚

easyapi/arxiv-search-scraper

Extract comprehensive research paper data from arXiv search results. Get detailed metadata including titles, authors, abstracts, categories and more. Perfect for academic research monitoring, trend analysis and building paper databases. 🎓📚

EasyApi

Google Scholar Scraper: Articles, Citations & PDFs

primeparse/google-scholar-scraper

Extract academic data from Google Scholar: titles, authors, years, citations, abstracts, PDF links. Supports queries, year filters (1900-2100), pagination (up to 5 pages). Rate-limited for safety. Ideal for research, citations, datasets, AI. Clean JSON output. Run on Apify with proxies.

PrimeParse

ArXiv Paper Search

gentle_cloud/arxiv-paper-search

Search and extract academic papers from ArXiv. Find papers by keyword, author, or category with full metadata including title, authors, abstract, categories, and PDF links.

Monkey Coder

🔬 arXiv Scraper - Scientific Papers, Abstracts & PDFs

benthepythondev/arxiv-scraper

arXiv Scraper for the official arXiv API. Search 2M+ scientific papers in CS, physics, math and biology by keyword, title, author, abstract or category. Extract title, authors, abstract, categories, DOI, dates and PDF links. For AI/ML research, literature reviews and RAG datasets.

Ben

arXiv Paper Scraper - AI Research Tracker

arjunannamalai/arxiv-paper-scraper

Track new arXiv papers by category, keyword and author. Clean output with authors, abstract and direct PDF links. Public API, no key.

Arjun Annamalai

arXiv Paper Scraper — AI Research, Abstracts & PDF Links

bovi/arxiv-scraper

Search arXiv papers by keyword, ID list, or category. Returns title, authors, abstract, categories, PDF URL, DOI, publish dates, and parse_confidence. Official Atom XML API — no proxy, no auth. Pay per result.

Vitalii Bondarev

ArXiv Paper Scraper

sheshinmcfly/arxiv-paper-scraper

Search and extract scientific papers from ArXiv.org. Returns title, authors, abstract, categories, submission date, and PDF link. Ideal for AI/ML research, RAG pipelines, academic trend monitoring, and systematic literature reviews. No API key required.