arXiv & PubMed Paper Search: Abstracts, Authors, DOI, MeSH & PDF Links

Search research papers on arXiv and PubMed in one run and get clean, structured metadata: title, abstract, authors, publication dates, DOI, journal, volume/issue/pages, arXiv categories, MeSH terms, keywords, publication types and links to the abstract page, PDF, PubMed and PubMed Central. Search by keyword, arXiv category and date range, or look up a list of arXiv IDs, PMIDs, PMCIDs and DOIs. Papers that appear in both databases are merged, and the only-new mode turns any search into a daily or weekly literature alert. Data comes from the official arXiv API and NCBI E-utilities (plus Crossref for other DOIs), so there is no fragile HTML scraping. $1 per 1,000 papers.

What you can use it for

• Literature reviews and systematic searches: export thousands of PubMed records with abstracts and MeSH terms to CSV/Excel in one run.
• Research alerts: schedule it daily with "only new papers" to get every new arXiv preprint in cs.CL or every new PubMed paper on your topic, without repeats.
• AI agents and RAG: feed abstracts and metadata to an LLM, a vector database or your agent through the API or Apify's MCP server.
• Reference lists: paste DOIs, PMIDs or arXiv links and get complete, consistent metadata for a bibliography.
• Trend and competitor research: track what a field, lab or keyword publishes over time (pharma, biotech, AI labs, investors).
• Dataset building: abstracts by category and date range for classification, topic modelling or benchmarks.

How to use it

1. Type a search query (e.g. large language models medicine). Use "quotes" for exact phrases. Advanced syntax works too: arXiv prefixes ti:, au:, abs:, cat: and PubMed tags like asthma[MeSH], review[pt], Smith J[au].
2. Choose where to search: arXiv + PubMed (default), arXiv only or PubMed only. Optionally add arXiv categories (cs.CL, cs.AI, q-bio.GN, astro-ph, ...) and a date range.
3. Or paste paper IDs, DOIs or links to look up specific papers.
4. Set max papers per source (default 50, up to 10,000) and click Start. Export the results as JSON, CSV, Excel or via the API.

Pricing

You pay $0.001 per paper ($1 per 1,000) plus $0.0005 per run start. Duplicates, already-seen papers in monitoring mode, IDs that are not found and errors are free.

Job	Papers	Price
Try it: 20 papers	20	$0.02
Daily alert, ~30 new papers a day for a month	~900	~$0.92
Literature review export	1,000	$1.00
Big PubMed export	9,999	$10.00

Most arXiv and PubMed Actors in the Store charge $1.5-$3 per 1,000 results, some add a start fee of up to $0.09, and the all-in-one research MCP servers charge $0.02-$0.06 per search. Here one Actor covers both databases, merges duplicates and remembers what you have already seen.

Before each run it checks your max cost per run and never fetches more papers than that budget can pay for.

Input example

{
  "query": "retrieval augmented generation",
  "source": "arxiv",
  "arxivCategories": ["cs.CL", "cs.IR"],
  "dateFrom": "2026-10-01",
  "sortBy": "newest",
  "maxResults": 200,
  "onlyNew": true
}

Look up specific papers:

{ "ids": ["2005.11401", "https://arxiv.org/abs/1706.03762", "33301246", "PMC7745181", "10.1038/s41586-020-2012-7"] }

Output example

Real records from a run (abstracts and long lists shortened here). Every record has the same fields in the same order, whichever database it came from, so CSV and Excel exports line up.

{
  "source": "pubmed",
  "id": "pubmed:33301246",
  "title": "Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine",
  "abstract": "BACKGROUND: Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection and the resulting coronavirus disease 2019 (Covid-19) have afflicted tens of millions of people in a worldwide pandemic. ...\nMETHODS: In an ongoing multinational, placebo-controlled, observer-blinded, pivotal efficacy trial, ...",
  "authors": ["Fernando P Polack", "Stephen J Thomas", "Nicholas Kitchin", "Judith Absalon", "..."],
  "authorCount": 30,
  "firstAuthor": "Fernando P Polack",
  "published": "2020-12-10",
  "updated": "2026-05-18",
  "year": 2020,
  "doi": "10.1056/nejmoa2034577",
  "arxivId": null,
  "version": null,
  "pmid": "33301246",
  "pmcid": "PMC7745181",
  "journal": "The New England journal of medicine",
  "journalAbbrev": "N Engl J Med",
  "journalRef": null,
  "issn": "1533-4406",
  "volume": "383",
  "issue": "27",
  "pages": "2603-2615",
  "primaryCategory": null,
  "categories": [],
  "meshTerms": ["Adolescent", "Adult", "Aged", "BNT162 Vaccine", "COVID-19", "COVID-19 Vaccines", "..."],
  "meshMajorTopics": ["COVID-19", "COVID-19 Vaccines", "SARS-CoV-2"],
  "keywords": [],
  "publicationTypes": ["Clinical Trial, Phase II", "Clinical Trial, Phase III", "Journal Article", "Multicenter Study", "Randomized Controlled Trial", "Research Support, Non-U.S. Gov't"],
  "language": "eng",
  "comment": null,
  "url": "https://pubmed.ncbi.nlm.nih.gov/33301246/",
  "pdfUrl": null,
  "doiUrl": "https://doi.org/10.1056/nejmoa2034577",
  "pubmedUrl": "https://pubmed.ncbi.nlm.nih.gov/33301246/",
  "pmcUrl": "https://pmc.ncbi.nlm.nih.gov/articles/PMC7745181/",
  "matchedBy": "id",
  "fetchedAt": "2026-10-21T07:20:52+00:00"
}

An arXiv record carries arxivId, version, primaryCategory, categories, the author comment (e.g. "Accepted at NeurIPS 2020"), journalRef and a direct pdfUrl such as https://arxiv.org/pdf/2005.11401v4. When the same paper is found in both databases, the kept record lists the other copy in alsoFoundIn.

The run summary (OUTPUT record) shows the total number of matches per database, so you know how much more there is. This one is from a real run with 10 newest papers per database on "large language models clinical" since 2026-09-01 plus 8 IDs (one unknown arXiv ID and one invalid input, both free):

{"papersSaved": 25, "duplicatesRemoved": 0, "alreadySeenSkipped": 0, "notFound": 1, "errors": 1,
 "totalMatches": {"arxiv": 198, "pubmed": 1081}, "apiRequests": {"arxiv": 2, "pubmed": 6, "crossref": 1},
 "stateKey": "seen-platform-test-t1", "stoppedByMaxCharge": false}

Monitoring: only new papers

Turn on Only new papers, sort by Newest first and schedule the Actor (Apify Schedules: daily or weekly). Each run remembers the papers it returned for that search (in a named key-value store in your account) and outputs only papers you have not seen. Already-seen papers are not charged. Use Monitoring name to keep several alerts apart, or to keep the memory when you edit the query. Connect the dataset to e-mail, Slack, Google Sheets, n8n or Make for an automatic alert.

Use it from code, n8n or AI agents

Call it through the Apify API (POST https://api.apify.com/v2/acts/manageable_gully~arxiv-pubmed-paper-search/run-sync-get-dataset-items), the Apify Python/JavaScript clients, the n8n/Make/Zapier integrations, or as a tool for AI agents via the Apify MCP server.

FAQ

Where does the data come from? From the official arXiv API, NCBI's official E-utilities for PubMed and the public Crossref REST API (only for DOIs that are neither in PubMed nor on arXiv). It follows their usage rules: at most one arXiv request every 3 seconds and at most 3 PubMed requests per second (10 with your own NCBI API key). Thank you to arXiv for use of its open access interoperability.

Does it download full texts? No. It returns metadata, abstracts and links. arXiv papers come with a direct pdfUrl; PubMed papers with a free full text in PubMed Central have a pmcUrl. For the text of a PDF, run the PDF link through our PDF & Image OCR Extractor. Respect the license of each paper.

Why do I get at most 9,999 PubMed papers per search? That is the E-utilities limit for one search. Split big searches into date ranges (e.g. one run per year) to get more.

Is the abstract always included? When the paper has one. Some PubMed records (letters, editorials, older papers) have no abstract. Turn Include abstracts off for smaller metadata-only datasets.

Do I need an NCBI API key? No. It is optional and only makes very large PubMed runs faster. You can get one for free in your NCBI account settings.

Does it collect personal data? It returns published bibliographic metadata: author names as printed on the paper and, only if you turn it on, affiliations with e-mail addresses removed. It does not collect contact details.

Which arXiv categories exist? See the arXiv category taxonomy. Examples: cs.AI, cs.CL, cs.CV, cs.LG, stat.ML, q-bio.GN, physics.med-ph, econ.EM. Use a top-level archive like cs or math to cover all its subcategories.

More tools from WebIntel Tools

• PDF & Image OCR to Text/Markdown: turn paper PDFs into text and tables
• Web Page to Markdown for LLMs: clean Markdown and RAG chunks from any URL
• RSS Feed Reader & Monitor: journal and blog feeds, only new items
• Website Screenshot & URL to PDF