arXiv Scraper: New Papers by Query avatar

arXiv Scraper: New Papers by Query

Pricing

from $0.70 / 1,000 arxiv paper extracteds

Go to Apify Store
arXiv Scraper: New Papers by Query

arXiv Scraper: New Papers by Query

Pull newly-submitted arXiv preprints by query. One row per paper: id, title, abstract, authors, categories, DOI, journal ref, author comment (often the accepted conference), PDF link. Built for cron with sinceDays:1. Source: arXiv Atom API (public, no auth).

Pricing

from $0.70 / 1,000 arxiv paper extracteds

Rating

0.0

(0)

Developer

vøiddo

vøiddo

Maintained by Community

Actor stats

0

Bookmarked

1

Total users

0

Monthly active users

16 hours ago

Last modified

Categories

Share

arXiv Daily New Papers Tracker: by Query

Pull newly-submitted arXiv preprints matching any query. One clean row per paper: arXiv id, title, abstract, authors, primary + cross-listed categories, DOI, journal ref, author comment (often the accepted conference name: gold for "what made it into ICML/NeurIPS"), and PDF link.

Built for cron: pass sinceDays: 1 and get yesterday's new papers in your topic. No auth, no scraping: pure arXiv Atom API.

Inputs

{
"queries": ["cat:cs.LG", "cat:cs.CL AND all:translation"],
"sinceDays": 1,
"maxResultsPerQuery": 500
}
inputdefaultnotes
queriesnoneRequired. arXiv query syntax. Examples: cat:cs.LG, cat:cs.CL AND all:translation, cat:q-bio.GN AND ti:"single-cell", or au: with a surname. Multi = union.
sinceDays7submittedDate >= now-sinceDays. Use 1 for daily cron.
maxResultsPerQuery500Cap per query. arXiv max is 2000 per call; we paginate.
includeAbstracttrueAdds ~2-4 KB of summary text per row. Set false for lightweight rows.

Output

One row per preprint:

fieldexample
arxivId2606.02578
versionv1
titleMitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge…
authors["Seojeong Park", "Jiho Choi", …]
primaryCategorycs.CV
categories["cs.CV", "cs.LG"]
published2026-06-01T17:59:46Z
updated2026-06-01T17:59:46Z
doi10.1145/... (if assigned)
journalRefNature Machine Intelligence, 2026 (if known)
commentICML 2026 ← this is the conference acceptance signal
pdfUrlhttps://arxiv.org/pdf/2606.02578v1
absUrlhttps://arxiv.org/abs/2606.02578v1
querythe originating query
abstractfull summary text (when includeAbstract is true)

Daily cron pattern

{ "queries": ["cat:cs.LG", "cat:cs.CL"], "sinceDays": 1 }

Real-world questions this answers

  • ML researcher. What's new in cs.LG today that I should skim?
  • VC scouting deep tech. Which papers landed at ICML/NeurIPS this week? (comment field)
  • Corporate R&D. New papers from competitor labs (au:) or topic (all:)?
  • Journal-club organiser. A weekly digest of cs.LG + cs.CL with abstracts.
  • Bibliometrics. A clean feed for downstream analytics (LangChain, citation graphs).

arXiv query syntax cheatsheet

operatormeaning
cat:cs.LGcategory filter (cs.LG, cs.CL, q-bio.GN, math.PR, …)
ti:"foo bar"title contains exact phrase
abs:fooabstract contains word
au: + surnameauthor
all:fooany field
AND / OR / ANDNOTboolean combinators

Full list at https://arxiv.org/help/api/user-manual#query_details.

What it doesn't do

  • No full-text extraction: we return only the metadata + abstract. Download the PDF yourself if you need the body.
  • No citation graph / references: separate problem, see Crossref / Semantic Scholar.
  • No author de-duplication / ORCID resolution: names as-published.

Pricing

Pay per event. Price per 1,000 events:

EventBase priceBronzeSilverGold
arXiv paper extracted$1.00$0.90$0.80$0.70

Bronze, Silver and Gold are the discounts Apify gives users of its paid plans. The Pricing tab always shows the current prices.

Run it through the API

Python, with the apify-client package:

from apify_client import ApifyClient
client = ApifyClient("<YOUR_APIFY_TOKEN>")
run = client.actor("v0iddo/arxiv-daily-papers").call(run_input={"queries": ["cat:cs.LG"], "maxResultsPerQuery": 20})
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
print(item)

JavaScript, with the apify-client package:

import { ApifyClient } from 'apify-client';
const client = new ApifyClient({ token: '<YOUR_APIFY_TOKEN>' });
const run = await client.actor('v0iddo/arxiv-daily-papers').call({"queries": ["cat:cs.LG"], "maxResultsPerQuery": 20});
const { items } = await client.dataset(run.defaultDatasetId).listItems();
console.log(items);

One HTTP call that waits for the run and returns the rows (for runs that finish within 5 minutes):

curl -X POST "https://api.apify.com/v2/acts/v0iddo~arxiv-daily-papers/run-sync-get-dataset-items?token=<YOUR_APIFY_TOKEN>" \
-H "Content-Type: application/json" \
-d '{"queries": ["cat:cs.LG"], "maxResultsPerQuery": 20}'

Use it from an agent (MCP)

Claude, Cursor, VS Code and other MCP clients can call this actor as a tool through the Apify MCP server. Add it to the client's MCP configuration:

{
"mcpServers": {
"apify": {
"url": "https://mcp.apify.com?tools=v0iddo/arxiv-daily-papers",
"headers": {
"Authorization": "Bearer <YOUR_APIFY_TOKEN>"
}
}
}
}

FAQ

Do I need an account, cookies or an API key?

No. The actor reads public data without logging in. You only need an Apify account to start it.

How many results can one run return?

Set Max results per query (up to 2,000) to the number you need. Large jobs can also be split into several runs or scheduled.

How am I charged?

Pay per event, at the prices on the Pricing tab for your Apify plan (the Pricing section of this page lists them). The platform usage of the run is included in those prices, and your spending limit for a run is always respected.

Why did my run return no results?

The status message and the log of the run say why: usually nothing matched the input, or the source did not answer for a moment. Check the input against the example above and run it again.

Can I run it on a schedule?

Yes. Save your input as a task and add a schedule in the Apify Console (daily, hourly or with a cron expression). Each run gets its own dataset, so you keep a history.

Which formats can I export?

JSON, CSV, Excel, XML, HTML table and RSS from the Output tab or the API. Integrations send the rows to Google Sheets, Slack, Make, Zapier, n8n or a webhook.

Is collecting this data allowed?

The actor collects data that the source publishes openly, without a login. Public data can still be personal data under laws such as the GDPR, and sources have their own terms: make sure your use of the data follows the rules that apply to you.

What happens when the source changes?

An automated test runs the actor every day on the example input and checks the rows, not only that the run finished. When a check fails, the actor is repaired and rebuilt; the build history on this page shows each update.

Something is missing or wrong. Where do I report it?

Open an issue on the Issues tab of this actor with the run link. Requests for a new field are welcome too.

Maintained by

vøiddo studio: small independent shop.