arXiv Scraper: New Papers by Query
Pricing
from $0.70 / 1,000 arxiv paper extracteds
arXiv Scraper: New Papers by Query
Pull newly-submitted arXiv preprints by query. One row per paper: id, title, abstract, authors, categories, DOI, journal ref, author comment (often the accepted conference), PDF link. Built for cron with sinceDays:1. Source: arXiv Atom API (public, no auth).
Pricing
from $0.70 / 1,000 arxiv paper extracteds
Rating
0.0
(0)
Developer
vøiddo
Maintained by CommunityActor stats
0
Bookmarked
1
Total users
0
Monthly active users
16 hours ago
Last modified
Categories
Share
arXiv Daily New Papers Tracker: by Query
Pull newly-submitted arXiv preprints matching any query. One clean row per paper: arXiv id, title, abstract, authors, primary + cross-listed categories, DOI, journal ref, author comment (often the accepted conference name: gold for "what made it into ICML/NeurIPS"), and PDF link.
Built for cron: pass sinceDays: 1 and get yesterday's new papers in your topic. No auth, no scraping: pure arXiv Atom API.
Inputs
{"queries": ["cat:cs.LG", "cat:cs.CL AND all:translation"],"sinceDays": 1,"maxResultsPerQuery": 500}
| input | default | notes |
|---|---|---|
queries | none | Required. arXiv query syntax. Examples: cat:cs.LG, cat:cs.CL AND all:translation, cat:q-bio.GN AND ti:"single-cell", or au: with a surname. Multi = union. |
sinceDays | 7 | submittedDate >= now-sinceDays. Use 1 for daily cron. |
maxResultsPerQuery | 500 | Cap per query. arXiv max is 2000 per call; we paginate. |
includeAbstract | true | Adds ~2-4 KB of summary text per row. Set false for lightweight rows. |
Output
One row per preprint:
| field | example |
|---|---|
| arxivId | 2606.02578 |
| version | v1 |
| title | Mitigating Perceptual Judgment Bias in Multimodal LLM-as-a-Judge… |
| authors | ["Seojeong Park", "Jiho Choi", …] |
| primaryCategory | cs.CV |
| categories | ["cs.CV", "cs.LG"] |
| published | 2026-06-01T17:59:46Z |
| updated | 2026-06-01T17:59:46Z |
| doi | 10.1145/... (if assigned) |
| journalRef | Nature Machine Intelligence, 2026 (if known) |
| comment | ICML 2026 ← this is the conference acceptance signal |
| pdfUrl | https://arxiv.org/pdf/2606.02578v1 |
| absUrl | https://arxiv.org/abs/2606.02578v1 |
| query | the originating query |
| abstract | full summary text (when includeAbstract is true) |
Daily cron pattern
{ "queries": ["cat:cs.LG", "cat:cs.CL"], "sinceDays": 1 }
Real-world questions this answers
- ML researcher. What's new in cs.LG today that I should skim?
- VC scouting deep tech. Which papers landed at ICML/NeurIPS this week? (
commentfield) - Corporate R&D. New papers from competitor labs (
au:) or topic (all:)? - Journal-club organiser. A weekly digest of
cs.LG+cs.CLwith abstracts. - Bibliometrics. A clean feed for downstream analytics (LangChain, citation graphs).
arXiv query syntax cheatsheet
| operator | meaning |
|---|---|
cat:cs.LG | category filter (cs.LG, cs.CL, q-bio.GN, math.PR, …) |
ti:"foo bar" | title contains exact phrase |
abs:foo | abstract contains word |
au: + surname | author |
all:foo | any field |
AND / OR / ANDNOT | boolean combinators |
Full list at https://arxiv.org/help/api/user-manual#query_details.
What it doesn't do
- No full-text extraction: we return only the metadata + abstract. Download the PDF yourself if you need the body.
- No citation graph / references: separate problem, see Crossref / Semantic Scholar.
- No author de-duplication / ORCID resolution: names as-published.
Pricing
Pay per event. Price per 1,000 events:
| Event | Base price | Bronze | Silver | Gold |
|---|---|---|---|---|
| arXiv paper extracted | $1.00 | $0.90 | $0.80 | $0.70 |
Bronze, Silver and Gold are the discounts Apify gives users of its paid plans. The Pricing tab always shows the current prices.
Run it through the API
Python, with the apify-client package:
from apify_client import ApifyClientclient = ApifyClient("<YOUR_APIFY_TOKEN>")run = client.actor("v0iddo/arxiv-daily-papers").call(run_input={"queries": ["cat:cs.LG"], "maxResultsPerQuery": 20})for item in client.dataset(run["defaultDatasetId"]).iterate_items():print(item)
JavaScript, with the apify-client package:
import { ApifyClient } from 'apify-client';const client = new ApifyClient({ token: '<YOUR_APIFY_TOKEN>' });const run = await client.actor('v0iddo/arxiv-daily-papers').call({"queries": ["cat:cs.LG"], "maxResultsPerQuery": 20});const { items } = await client.dataset(run.defaultDatasetId).listItems();console.log(items);
One HTTP call that waits for the run and returns the rows (for runs that finish within 5 minutes):
curl -X POST "https://api.apify.com/v2/acts/v0iddo~arxiv-daily-papers/run-sync-get-dataset-items?token=<YOUR_APIFY_TOKEN>" \-H "Content-Type: application/json" \-d '{"queries": ["cat:cs.LG"], "maxResultsPerQuery": 20}'
Use it from an agent (MCP)
Claude, Cursor, VS Code and other MCP clients can call this actor as a tool through the Apify MCP server. Add it to the client's MCP configuration:
{"mcpServers": {"apify": {"url": "https://mcp.apify.com?tools=v0iddo/arxiv-daily-papers","headers": {"Authorization": "Bearer <YOUR_APIFY_TOKEN>"}}}}
FAQ
Do I need an account, cookies or an API key?
No. The actor reads public data without logging in. You only need an Apify account to start it.
How many results can one run return?
Set Max results per query (up to 2,000) to the number you need. Large jobs can also be split into several runs or scheduled.
How am I charged?
Pay per event, at the prices on the Pricing tab for your Apify plan (the Pricing section of this page lists them). The platform usage of the run is included in those prices, and your spending limit for a run is always respected.
Why did my run return no results?
The status message and the log of the run say why: usually nothing matched the input, or the source did not answer for a moment. Check the input against the example above and run it again.
Can I run it on a schedule?
Yes. Save your input as a task and add a schedule in the Apify Console (daily, hourly or with a cron expression). Each run gets its own dataset, so you keep a history.
Which formats can I export?
JSON, CSV, Excel, XML, HTML table and RSS from the Output tab or the API. Integrations send the rows to Google Sheets, Slack, Make, Zapier, n8n or a webhook.
Is collecting this data allowed?
The actor collects data that the source publishes openly, without a login. Public data can still be personal data under laws such as the GDPR, and sources have their own terms: make sure your use of the data follows the rules that apply to you.
What happens when the source changes?
An automated test runs the actor every day on the example input and checks the rows, not only that the run finished. When a check fails, the actor is repaired and rebuilt; the build history on this page shows each update.
Something is missing or wrong. Where do I report it?
Open an issue on the Issues tab of this actor with the run link. Requests for a new field are welcome too.
Related actors
- Crossref Scraper: Recent Publications by Query
- NIH RePORTER Scraper: Research Grants by Query
- News Article Extractor: Full Text from Links and RSS
- Substack Posts Scraper: Archive, Reactions, Comments
- Hacker News Scraper: Stories and Comments by Query
Maintained by
vøiddo studio: small independent shop.