# arXiv Scraper API – AI Research Papers & PDF (`fluyeporlaweb/arxiv-papers-scraper`) Actor arXiv scraper for AI research papers via API by keyword or category (cs.AI, cs.CL): title, abstract, DOI, PDF link. CC0 metadata. RAG/LLM-ready, MCP. - **URL**: https://apify.com/fluyeporlaweb/arxiv-papers-scraper.md - **Developed by:** [Pablo Navarro](https://apify.com/fluyeporlaweb) (community) - **Categories:** AI, Automation, News - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing from $2.20 / 1,000 papers This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events. Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event ## What's an Apify Actor? An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md. ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run. For examples already wired to this Actor's own input schema, see the [API](#api) section below. Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`). # README ## arXiv Scraper API – AI Research Papers & PDF **arXiv scraper** for **AI research papers** via the official arXiv API: search by keyword or category (`cs.AI`, `cs.CL`, …) and get **title, abstract, DOI, version and PDF link**. CC0 metadata. RAG/LLM-ready JSON, MCP-friendly. ### What does it do? - Query arXiv Atom API by free text and/or category codes. - Return arXiv id, version, title, abstract, DOI, PDF URL and categories when present. - Sort by newest or relevance; cap with `maxItems`. - Metadata is CC0; abstracts are author-supplied. ### Use cases - **AI research monitoring**: watch new cs.AI / cs.CL papers daily. - **RAG corpora**: ingest titles + abstracts + PDF links into vector stores. - **Literature reviews**: export JSON/CSV of matching preprints. - **AI agents**: fetch latest arXiv papers through Apify MCP. ### Input | Field | Description | |---|---| | `query` | Free-text query. Example: retrieval augmented generation | | `categories` | Optional arXiv category codes. Example: cs.AI, cs.CL | | `sortBy` | newest or relevance. Default newest. | | `maxItems` | Max papers. Example: 25 | Example input: ```json { "query": "large language model", "categories": [ "cs.AI", "cs.CL" ], "sortBy": "newest", "maxItems": 10 } ``` ### Output Real output (sample from a prior run on 27 Oct 2026, Europe/Madrid): ```json [ { "arxivId": "2610.32755", "version": "v1", "title": "Semantic Representation for Agentic Self-Play in Automated Laboratories", "abstract": "Navigating complex, high-dimensional biological search spaces necessitates scalable physical and computational intelligence to explore beyond local optima through iterative self-play across ideation, experimentation, and automation. Translating experimental designs into reliable physical execution remains bottlenecked by static laboratory automation and unmodeled physical variability. To address this, we introduce VERified Infrastructure for Discovery Laboratories, or VERID, a foundational infrastructure designed to bridge the gap between the high-level reasoning of artificial intelligence (AI) agents and complex, error-prone physical realities of wet labs. VERID is a persistent, high-fidelity semantic digital twin of the laboratory workcell that provides four core services: queryable introspection for agentic reasoning, time-compressed simulation for protocol validation, comprehensive trace persistence for a complete scientific record, and a framework for safe execution. We present three case studies using aqueous dye and deionized water mixtures to validate the optical and fluidic foundations of VERID. These studies demonstrate how VERID enables pre-emptive detection of critical errors in experimental protocols, stateful mid-run error recovery and post-hoc identification of subtle physical failures. The simulation functions as a discrete accounting engine, allowing agents to safely and inexpensively explore experimental designs in silico and refine experimental strategies through iterative self-play. VERID also captures structured multimodal experimental data for downstream analysis, knowledge mining and agent training. We argue that this semantic layer is an essential prerequisite for deploying autonomous agents in the biochemical and biomedical sciences, ensuring data integrity, operational safety, and paving the way for tackling previously intractable grand challenges in biology.", "published": "2026-10-23T15:00:16Z", "updated": "2026-10-23T15:00:16Z", "primaryCategory": "cs.RO", "categories": [ "cs.RO", "cs.AI" ], "authorsCount": 15, "doi": null, "journalRef": null, "comment": "16 pages, 4 figures", "url": "https://arxiv.org/abs/2610.32755", "pdfUrl": "https://arxiv.org/pdf/2610.32755v1" }, { "arxivId": "2610.32738", "version": "v1", "title": "Agentic Hazard Mapper: Emulating Expert Map-Making with AI Agents for Risk Communication", "abstract": "Hazard maps are essential tools for public risk communication, preparedness, and evacuation planning, yet effective cartographic design is not always ensured due to limited access to cartographic expertise across local governments and communities. We present Agentic Hazard Mapper, a multi-agent system that automates hazard-map production by emulating professional cartographic workflows and iterative design trade-offs while adapting design decisions to different data, locations, and hazard contexts. We conducted a formative study with map experts to inform the system design, followed by a user study and interviews with map experts and hazard practitioners. The generated maps improved participants' spatial understanding and evacuation-planning performance, reduced perceived workload and task completion time, and were generally preferred over corresponding municipal maps. We further discuss human oversight, adaptation across users and communication contexts, and opportunities to extend agentic support across broader stages of hazard-map production and risk communication.", "published": "2026-10-23T14:53:40Z", "updated": "2026-10-23T14:53:40Z", "primaryCategory": "cs.AI", "categories": [ "cs.AI" ], "authorsCount": 5, "doi": null, "journalRef": null, "comment": null, "url": "https://arxiv.org/abs/2610.32738", "pdfUrl": "https://arxiv.org/pdf/2610.32738v1" } ] ``` Export as JSON, CSV or Excel, read through the API, or send to Google Sheets, Make, Zapier, n8n or webhooks. You can also run this Actor from AI agents through the Apify MCP server. ### Pricing Pay per event: **$2.20 per 1,000 papers plus $0.00005 per run start.** There is no extra platform usage charge beyond Apify’s normal platform fees if any apply to your plan. ### FAQ **Is a login required?** No. Uses the public arXiv API. **License?** arXiv metadata is CC0; paper PDFs keep their original licenses — check each paper. **Can AI agents use it?** Yes. JSON with abstracts and PDF links works well for RAG and MCP clients. ### Data source and license Source: [arXiv API](https://info.arxiv.org/help/api/index.html). Metadata CC0. Not affiliated with arXiv or Cornell. This Actor is not affiliated with or endorsed by the data source. You are responsible for using the data in line with the source's license and terms. # Actor input Schema ## `query` (type: `string`): Search in title, abstract and comments. Example: AI agents ## `categories` (type: `array`): Any of these categories. Example: cs.AI, cs.CL, cs.LG ## `sortBy` (type: `string`): newest = submission date. ## `maxItems` (type: `integer`): Example: 50 ## Actor input object example ```json { "sortBy": "newest", "maxItems": 50 } ``` # Actor output Schema ## `items` (type: `string`): No description ## `summary` (type: `string`): No description # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("fluyeporlaweb/arxiv-papers-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("fluyeporlaweb/arxiv-papers-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}") for item in client.dataset(run.default_dataset_id).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call fluyeporlaweb/arxiv-papers-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "type": "http", "url": "https://mcp.apify.com/?tools=fetch-actor-details,fluyeporlaweb/arxiv-papers-scraper" } } } ``` The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer ` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations). ## OpenAPI specification Download the OpenAPI definition: https://api.apify.com/v2/actors/E57mzNxZqryYYVQf5/builds/5GD7LgOjgNdp62DPH/openapi.json