ArXiv Papers Scraper avatar

ArXiv Papers Scraper

Under maintenance

Pricing

from $0.10 / 1,000 dataset items

Go to Apify Store
ArXiv Papers Scraper

ArXiv Papers Scraper

Under maintenance

Search and scrape academic papers from the arXiv API by keyword, category, or author.

Pricing

from $0.10 / 1,000 dataset items

Rating

0.0

(0)

Developer

Moeeze Hassan

Moeeze Hassan

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

4 days ago

Last modified

Categories

Share

Search and scrape academic papers from the arXiv API by keyword, category, or author. The actor queries the arXiv Atom XML feed and returns structured paper records including title, authors, abstract, category, and direct PDF/abstract URLs.

Features

  • Full-text and metadata search via the arXiv search API
  • Optional category filter (e.g. cs.AI, cs.CL, stat.ML)
  • Sort by relevance or date, ascending or descending
  • Direct links to the PDF and abstract pages

Input Fields

FieldTypeRequiredDefaultDescription
querystring""Search query (keyword, author name, or phrase).
maxResultsinteger20Maximum number of papers to return (1–200).
sortBystring (enum)relevanceSort results by relevance or date.
sortOrderstring (enum)descendingSort order: descending or ascending.
categorystring""Optional arXiv category filter (e.g. cs.AI, cs.CL, stat.ML).

At least a query or category must be provided.

Output Fields

Each pushed dataset item is a paper record with the following fields:

FieldTypeDescription
idstringarXiv paper ID (e.g. 2301.12345v1).
titlestringPaper title.
authorsarray<string>List of author names.
abstractstringPaper abstract (whitespace-collapsed).
publishedDatestringOriginal publication date (ISO-8601).
updatedDatestringLast updated date (ISO-8601).
primaryCategorystringPrimary arXiv category.
pdfUrlstringDirect URL to the PDF.
arxivUrlstringURL to the arXiv abstract page.

Usage Example

Search for papers on "transformer attention"

{
"query": "transformer attention",
"maxResults": 20,
"sortBy": "relevance",
"sortOrder": "descending"
}

Get the latest 10 papers in the cs.AI category

{
"query": "",
"category": "cs.AI",
"maxResults": 10,
"sortBy": "date",
"sortOrder": "descending"
}

Search for a specific author with a category filter

{
"query": "Yann LeCun",
"category": "cs.LG",
"maxResults": 50,
"sortBy": "date",
"sortOrder": "descending"
}

Run via the Apify CLI

$apify run arxiv-papers-scraper --input '{"query":"transformer attention","maxResults":20}'

Data Source

Papers are fetched from the arXiv export API at http://export.arxiv.org/api/query, which returns an Atom XML feed.