# arXiv Paper Tracker - Free Academic API (`wiry_kingdom/arxiv-paper-tracker`) Actor Track new arXiv papers. Filter by category (cs.AI, cs.LG, q-bio.NC...), author, keyword, date. Returns title, authors, abstract, PDF link, DOI. Free official arXiv API. For AI/ML researchers, biotech analysts, journalists. - **URL**: https://apify.com/wiry\_kingdom/arxiv-paper-tracker.md - **Developed by:** [Mohieldin Mohamed](https://apify.com/wiry_kingdom) (community) - **Categories:** Business, Developer tools - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per event This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## arXiv Paper Tracker **Track new academic papers on arXiv. Filter by category, author, keyword, or date. Free official arXiv API. No key required.** This actor uses the official arXiv Atom-format public API to extract paper metadata with full structured fields. Tested on real data: 172,328 cs.AI papers, 307,287 cs.LG diffusion model papers, 759 papers with "Hinton" co-authors. ### What you actually get Real papers returned in test runs: | ID | Title | Authors | |----|-------|---------| | 2604.13029v1 | Visual Preference Optimization with Rubric Rewards | 18 authors led by Ya-Qi Yu | | 2401.05779v4 | Erasing Undesirable Influence in Diffusion Models | Jing Wu, Trung Le, Munawar Hayat | | 2603.24741v1 | The Diffuse Gamma-ray Sky of a Milky Way Analogue | 11 authors incl. Jim Hinton | Each row includes: - arXiv ID (e.g. `2604.13029v1`) - Title (cleaned of XML escaping) - Full author list as array - Primary category + all categories (cs.AI, cs.CV, hep-ph, etc.) - Published date and last-updated date - Full abstract (optional) - Direct links: HTML abstract page + PDF - DOI (when paper is linked to a published version) - Author comment (e.g. "Accepted at NeurIPS 2024", page count) - Journal reference (when published) ### Why use this arXiv hosts **2.5 million+ research papers** across CS, math, physics, biology, economics, and more. ~17,000 new papers are submitted **every week**. Tracking new releases in your domain is essential for: - **AI/ML researchers** — be the first to read new SOTA papers in your area - **Tech investors and VCs** — predict which research areas will become commercial in 12-24 months - **Science journalists** — break stories on new papers from labs you watch - **Biotech analysts** — track competitive research from labs at Big Pharma + universities - **Indie hackers building AI tools** — find new papers for your RAG dataset - **Academic literature reviewers** — automate paper discovery for systematic reviews - **Patent attorneys and IP firms** — track prior art in real time - **Newsletters and blogs** — automate "this week in AI" content sourcing Commercial alternatives that do similar things: - **Semantic Scholar API** — free, but rate-limited and missing some fields - **Connected Papers** — $5-15/month, beautiful UI but no bulk export - **Paperscape** — free, visual, but no API - **Google Scholar Alerts** — free, email only, no structured export - **Scite.ai** — $99-499/month, citation-focused This actor delivers structured JSON output with pay-per-event pricing — perfect for low-volume use that doesn't justify a $99/month subscription. ### Honest limitations - **arXiv has a self-imposed 3-second rate limit** between requests. We comply, so large pulls (10,000+ papers) take a while. - **arXiv author search is fuzzy.** Searching `"Hinton"` matches any author with "Hinton" in their name, not just Geoffrey Hinton. Use `"Geoffrey Hinton"` or include co-authors for disambiguation. - **The boolean query syntax is arXiv's own**, not standard SQL. Use `AND`, `OR`, `ANDNOT`, parentheses. Field prefixes: `ti:` (title), `au:` (author), `abs:` (abstract), `cat:` (category), `all:` (anywhere). - **arXiv only covers preprints**, not peer-reviewed final versions. Many papers eventually get DOIs, but the abstract on arXiv may differ slightly from the published version. - **arXiv ID versions matter.** `2604.13029v1` and `2604.13029v2` are different revisions. We return whatever version was current at fetch time. ### How to use 1. Click **Try for free** (or **Start**) 2. Pick **categories** to filter (e.g. `["cs.AI", "cs.LG"]`) 3. Optionally add **search query** with arXiv syntax (e.g. `"transformer ANDNOT survey"`) 4. Optionally add **author names** for disambiguation 5. Pick **sort order** (newest first / recently updated / relevance) 6. Set **max results** (default 50, max 50,000) 7. Click **Start** ### Common arXiv categories | Code | Field | |------|-------| | `cs.AI` | Artificial Intelligence | | `cs.LG` | Machine Learning | | `cs.CL` | Computation and Language (NLP) | | `cs.CV` | Computer Vision | | `cs.RO` | Robotics | | `cs.NE` | Neural and Evolutionary Computing | | `cs.IR` | Information Retrieval | | `cs.CR` | Cryptography and Security | | `cs.DC` | Distributed Computing | | `cs.SE` | Software Engineering | | `cs.HC` | Human-Computer Interaction | | `stat.ML` | Statistics - Machine Learning | | `math.OC` | Math - Optimization and Control | | `q-bio.NC` | Quantitative Biology - Neurons and Cognition | | `q-fin.TR` | Quantitative Finance - Trading and Microstructure | | `econ.EM` | Economics - Econometrics | | `physics.bio-ph` | Physics - Biological Physics | | `hep-ph` | High Energy Physics - Phenomenology | Full list: https://arxiv.org/category_taxonomy ### Output ```json { "arxivId": "2604.13029v1", "title": "Visual Preference Optimization with Rubric Rewards", "authors": ["Ya-Qi Yu", "Fangyu Hong", "Xiangyang Qu", "Hao Wang", "..."], "primaryCategory": "cs.CV", "categories": ["cs.CV", "cs.AI"], "publishedAt": "2026-04-14T17:58:22Z", "updatedAt": "2026-04-14T17:58:22Z", "abstract": "The effectiveness of Direct Preference Optimization (DPO) depends on preference data...", "absUrl": "https://arxiv.org/abs/2604.13029v1", "pdfUrl": "https://arxiv.org/pdf/2604.13029v1", "doi": null, "comment": "12 pages, 5 figures", "journalRef": null, "extractedAt": "2026-04-15T21:35:00.000Z" } ```` ### Pricing This actor uses **pay-per-event** pricing — extremely cheap given how cheap academic data is to extract: - **Actor start**: $0.05 per run - **Per paper extracted**: $0.005 per paper **Example costs:** - 100 latest cs.AI papers → $0.55 - 1,000 papers for a literature review → $5.05 - Daily check on cs.LG (50 new papers/day) → ~$8/month - Bulk pull of all 50,000 cs.CL papers ever → $250.05 For comparison: Connected Papers Pro is $5/month with limited filters. Scite.ai is $99/month base. Most academic researchers can use this actor for under $5/month. Free Apify tier members get $5/month in platform credits, which covers ~1,000 papers per month. ### Tips - **Use `sortBy: submittedDate`** for new-paper alerts (default) - **Use `sortBy: relevance`** when you have a search query and want the best matches first - **Combine categories with `+OR+`** in your downstream pipeline if you want union, or pass multiple categories in the input array (we OR them automatically) - **Schedule daily runs** with date filters in your downstream code to build a fresh-papers queue - **Pipe abstracts into an LLM** for summarization — each paper is ~200-400 tokens of abstract, perfect for batch summarization ### Source This actor uses the official **arXiv Atom-format query API** at `http://export.arxiv.org/api/query`. The API is documented at https://info.arxiv.org/help/api/index.html. It's free, public, requires no authentication, and is maintained by Cornell University as a community service. ### License This actor is MIT licensed. arXiv papers themselves are licensed individually by their authors — most use Creative Commons or arXiv's nonexclusive license. **Always cite the original paper** when using extracted abstracts in your work. # Actor input Schema ## `categories` (type: `array`): List of arXiv category codes. Common: cs.AI (artificial intelligence), cs.CL (computation and language), cs.LG (machine learning), cs.CV (computer vision), q-bio.NC (neural and cognitive), hep-ph (high-energy physics phenomenology), math.OC (optimization). Empty = use search query only. ## `searchQuery` (type: `string`): Free-text search across title, abstract, comments, authors. Use arXiv's syntax: AND, OR, ANDNOT, parentheses. Example: 'attention AND transformer ANDNOT survey'. Empty = no text filter. ## `authors` (type: `array`): Filter by author name (e.g. \['Hinton', 'LeCun', 'Bengio']). Searches the author field. ## `sortBy` (type: `string`): How to sort results. submittedDate (newest first), lastUpdatedDate (recently updated first), or relevance. ## `maxResults` (type: `integer`): Cap on papers extracted. arXiv returns up to 2000 per request; we paginate up to 50,000 total. ## `includeAbstracts` (type: `boolean`): Include the full paper abstract. Recommended for RAG/training datasets. ## `proxyConfiguration` (type: `object`): Optional Apify Proxy. arXiv is friendly to direct access — proxy rarely needed. ## Actor input object example ```json { "categories": [ "cs.AI" ], "searchQuery": "", "authors": [], "sortBy": "submittedDate", "maxResults": 50, "includeAbstracts": true, "proxyConfiguration": { "useApifyProxy": false } } ``` # Actor output Schema ## `dataset` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "categories": [ "cs.AI" ] }; // Run the Actor and wait for it to finish const run = await client.actor("wiry_kingdom/arxiv-paper-tracker").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "categories": ["cs.AI"] } # Run the Actor and wait for it to finish run = client.actor("wiry_kingdom/arxiv-paper-tracker").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "categories": [ "cs.AI" ] }' | apify call wiry_kingdom/arxiv-paper-tracker --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=wiry_kingdom/arxiv-paper-tracker", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "arXiv Paper Tracker - Free Academic API", "description": "Track new arXiv papers. Filter by category (cs.AI, cs.LG, q-bio.NC...), author, keyword, date. Returns title, authors, abstract, PDF link, DOI. Free official arXiv API. For AI/ML researchers, biotech analysts, journalists.", "version": "0.1", "x-build-id": "8k4EO7H5JVfj72kJ1" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/wiry_kingdom~arxiv-paper-tracker/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-wiry_kingdom-arxiv-paper-tracker", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/wiry_kingdom~arxiv-paper-tracker/runs": { "post": { "operationId": "runs-sync-wiry_kingdom-arxiv-paper-tracker", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/wiry_kingdom~arxiv-paper-tracker/run-sync": { "post": { "operationId": "run-sync-wiry_kingdom-arxiv-paper-tracker", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "properties": { "categories": { "title": "arXiv categories", "type": "array", "description": "List of arXiv category codes. Common: cs.AI (artificial intelligence), cs.CL (computation and language), cs.LG (machine learning), cs.CV (computer vision), q-bio.NC (neural and cognitive), hep-ph (high-energy physics phenomenology), math.OC (optimization). Empty = use search query only.", "default": [ "cs.AI" ], "items": { "type": "string" } }, "searchQuery": { "title": "Search query", "type": "string", "description": "Free-text search across title, abstract, comments, authors. Use arXiv's syntax: AND, OR, ANDNOT, parentheses. Example: 'attention AND transformer ANDNOT survey'. Empty = no text filter.", "default": "" }, "authors": { "title": "Author names", "type": "array", "description": "Filter by author name (e.g. ['Hinton', 'LeCun', 'Bengio']). Searches the author field.", "default": [], "items": { "type": "string" } }, "sortBy": { "title": "Sort order", "enum": [ "submittedDate", "lastUpdatedDate", "relevance" ], "type": "string", "description": "How to sort results. submittedDate (newest first), lastUpdatedDate (recently updated first), or relevance.", "default": "submittedDate" }, "maxResults": { "title": "Max results", "minimum": 1, "maximum": 50000, "type": "integer", "description": "Cap on papers extracted. arXiv returns up to 2000 per request; we paginate up to 50,000 total.", "default": 50 }, "includeAbstracts": { "title": "Include abstracts", "type": "boolean", "description": "Include the full paper abstract. Recommended for RAG/training datasets.", "default": true }, "proxyConfiguration": { "title": "Proxy configuration", "type": "object", "description": "Optional Apify Proxy. arXiv is friendly to direct access — proxy rarely needed.", "default": { "useApifyProxy": false } } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```