Research Papers Scraper: PubMed, arXiv, Patents & Trials

Research Papers Scraper: PubMed, arXiv, Patents & Trials (Research Radar)

Search OpenAlex, arXiv, PubMed, Europe PMC and worldwide patents (European Patent Office) at once, plus DOAJ open-access journals, ClinicalTrials.gov trials and DataCite datasets when you pick them, and get one clean, deduplicated, newest-first list of papers, preprints, patents, trials and datasets - with abstracts, authors and affiliations, DOIs, PDF links, citation counts and open-access status. Schedule it with Only new results and it becomes a research alert; follow it as an RSS/Atom feed; add AI summaries and multilingual search on your own AI key.

Built for R&D and innovation teams watching a technology, IP and patent professionals tracking prior art, pharma and biotech scouting new findings, investors and analysts following a field, librarians, and AI agents that need fresh research.

Why this radar

• Many sources, one record each. The same paper found by OpenAlex, PubMed and Europe PMC comes back once, with the best fields from each and a foundIn list. Matching uses DOIs, PubMed / PMC / arXiv ids and normalized titles.
• Fresh first. Results are sorted newest first; filter by Published within N days or a start date.
• Research alerts. Schedule it with Only new results: each run returns only what earlier runs didn't deliver, so you pay only for new papers.
• RSS / Atom feed. Call the Actor's Standby URL with &format=atom and paste it into Feedly, Slack, Teams, Inoreader or Zapier. Repeat polls within 30 minutes are served from memory - no new search, no new charge.
• AI summaries and multilingual search (optional). Get a short plain-language summary of each result, or search your query translated into other languages (e.g. German, Japanese, Chinese). Use Apify's built-in AI (no key; a fraction of a cent per call, billed to your Apify account) or your own Anthropic, OpenAI, Gemini, OpenRouter, Groq, Mistral, DeepSeek or local model. The Actor charges nothing extra for AI.
• Influence, not just volume. Each paper carries its citations per year, a field-normalized impact (1.0 = the world average for papers of the same field and year) and a top 1% / top 10% flag. Sort by Most cited or Highest impact to find the work that matters.
• Retractions left out. Retracted papers are dropped by default (or kept and flagged, if you ask).
• Ready to share and cite. Every run saves a readable digest (REPORT: newest and most influential per query) and CITATIONS.bib for Zotero, Mendeley, EndNote or LaTeX.
• Official open sources only. Fast, reliable runs.

How to use it

1. Enter one or more search queries (solid state battery, CRISPR base editing, "retrieval augmented generation").
2. Pick sources (the five main ones are on by default; add DOAJ, ClinicalTrials.gov, DataCite or Crossref) and optionally Published within (days).
3. Press Start. For alerts, turn on Only new results and add a schedule (daily or weekly).

Example input:

{
  "queries": ["solid state battery", "sulfide electrolyte"],
  "postedWithinDays": 30,
  "maxItems": 200,
  "onlyNew": true
}

Output

Field	Description
type	paper, preprint, patent, trial, dataset or software
title, abstract	As published
authors	[{name, affiliation, orcid, country}] when the source has them
publishedAt	Publication date (YYYY-MM-DD)
venue	Journal, server (arXiv) or repository
doi, url, pdfUrl	Identifiers and links (PDF when openly available)
openAccess, citations, language, keywords	When known
citationsPerYear	Citations divided by years since publication
fieldNormalizedImpact, citationRank	Impact against papers of the same field and year (1.0 = average); top 1% / top 10%
retracted	true for retracted papers (only with Include retracted)
ids	openalex, pmid, pmcid, arxiv, europepmc, nct, doaj
patent	For patents: number, kind, country, familyId, applicationNumber, filingDate, priorityDate, classifications (IPC), applicants
trial	For clinical trials: nctId, status, phases, studyType, conditions, interventions, sponsor, sponsorClass, enrollment, startDate, completionDate, lastUpdated, locations, countries, hasResults
foundIn	Every source that returned it
query, matchedQuery, queryLanguage	Which of your queries found it (and the translation, for multilingual search)
aiSummary	With AI summaries on

The key-value store also holds REPORT (a Markdown digest to read or forward) and CITATIONS (BibTeX).

Sources

Source	Covers
OpenAlex	250M+ scholarly works in every field (journals, conferences, books, preprints)
arXiv	Preprints in physics, computer science, maths, quantitative biology and finance, statistics, engineering
PubMed	Biomedical and life-science literature
Europe PMC	Life-science literature and preprints (bioRxiv, medRxiv, Research Square...)
Patents	Worldwide patent publications from the European Patent Office's database (EP, WO/PCT, US, CN, JP, KR and 100+ offices) with English titles and abstracts, applicants, inventors and IPC classes
Crossref (optional)	DOI metadata from publishers
DOAJ (optional)	Articles from 20,000+ peer-reviewed open-access journals
ClinicalTrials.gov (optional)	Registered clinical trials worldwide: status, phase, conditions, interventions, sponsor, enrollment, countries; newest updates first
DataCite (optional)	Datasets, software and preprints with DOIs from Zenodo, Figshare, Dryad and institutional repositories

Pricing

$3 per 1,000 results (each paper or patent counts once, however many sources found it) plus a small start fee per run. Duplicates and, with Only new results, already-delivered items are free. AI summaries and translations cost the model's tokens: a fraction of a cent each with the built-in AI (billed to your Apify account by Apify's AI gateway), or your provider's price with your own key. See the Pricing tab, and set a maximum charge per run to cap spend.

Tips

• Use several specific queries rather than one broad one; results are merged.
• Queries match titles and abstracts, so papers that only mention your words in passing stay out.
• For a literature review, set Sort by to Highest impact with Published within 1,100 days: the most influential work of the last three years, deduplicated, with BibTeX.
• For a weekly alert, set Published within to 8 days and schedule weekly with Only new results.
• A free OpenAlex key gives your runs their own daily budget.

Use from AI agents

The Actor is also an MCP tool (Standby /mcp), and part of the webdata-tools-mcp server.