Pricing

from $10.00 / 1,000 results

Go to Apify Store

Unified Preprint Search

Try for free

One Apify Actor, five sources: PubMed, arXiv, bioRxiv, medRxiv, chemRxiv.

Pricing

from $10.00 / 1,000 results

Rating

0.0

(0)

Developer

Logical Vivacity

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Unified Preprint & Journal Search

One Apify Actor, five sources: PubMed, arXiv, bioRxiv, medRxiv, chemRxiv.

Run a single keyword query, get a normalized, deduped dataset with one paper per row and (optionally) citation counts.

What it does

Accepts a Boolean keyword query (AND between groups, OR within groups).
Queries each selected source.
Normalizes results into a unified record schema.
Deduplicates across sources by DOI.
Optionally enriches each paper with a Semantic Scholar citation count.
Streams every paper to the dataset as it's processed (no in-memory accumulation).

Inputs

Field	Type	Default	Description
`keywords`	array of arrays of strings (or flat array)	— (required)	Nested groups: outer = AND, inner = OR. A flat list is treated as AND of single-term groups.
`sources`	array of enum	all 5	Subset of `pubmed`, `arxiv`, `biorxiv`, `medrxiv`, `chemrxiv`.
`startDate`	ISO date string	—	Drop records with `date` before this.
`endDate`	ISO date string	—	Drop records with `date` after this.
`maxResultsPerSource`	integer	`200`	Hard cap per source.
`enrichWithCitations`	boolean	`false`	Look up citation counts (slow, rate-limited).

Example query

{
  "keywords": [
    ["COVID-19", "SARS-CoV-2"],
    ["deep learning", "machine learning"],
    ["medical imaging"]
  ],
  "sources": ["pubmed", "arxiv", "biorxiv"],
  "maxResultsPerSource": 100,
  "enrichWithCitations": false
}

This means: (COVID-19 OR SARS-CoV-2) AND (deep learning OR machine learning) AND (medical imaging).

Output sample

Each dataset item:

{
  "source": "arxiv",
  "title": "Deep learning for COVID-19 chest X-ray classification",
  "authors": ["Jane Doe", "John Smith"],
  "abstract": "We propose a CNN architecture ...",
  "doi": "10.1234/example.2024.0001",
  "date": "2024-03-12",
  "journal": "arXiv:2403.01234",
  "url": "https://arxiv.org/abs/2403.01234",
  "citations_count": 17,
  "raw": { "...": "any unmapped fields preserved here" }
}

Limitations

Rate limits. PubMed (NCBI E-utilities), arXiv and Semantic Scholar all rate-limit anonymous traffic. To raise the citation-enrichment limit, paste a free Semantic Scholar API key into the semanticScholarApiKey input field.
X-rxiv server dumps. bioRxiv, medRxiv and chemRxiv require a local JSONL dump. The first run on a fresh container will trigger a download of these dumps (medRxiv ~30 min, bioRxiv ~3 hr, chemRxiv ~15 min). Plan memory and timeout accordingly, or pre-bake dumps into the Docker image for production use.
Date filtering is applied client-side; not all sources return well-formed dates.
Dedup is by DOI only — papers without a DOI may appear once per source.

bioRxiv + medRxiv Scraper for RAG

devanshlive/biorxiv-medrxiv-rag-extractor

Scrape bioRxiv and medRxiv preprints by server, category, and date range. Returns RAG-ready JSON with JATS full-text chunks (cl100k_base, 512/50) when available and abstract fallback otherwise. Drop-in for LangChain, LlamaIndex, Qdrant, Pinecone, Weaviate, pgvector. $0.02 per preprint.

Devansh Tiwari

Europe PMC Biomedical Literature Search

ryanclinton/europe-pmc-search

Search and extract biomedical and life science publications from Europe PMC -- a free, comprehensive repository of over 40 million articles aggregated from PubMed, PubMed Central (PMC), and preprint servers including bioRxiv and medRxiv.

ryan clinton

medRxiv Scraper

parseforge/medrxiv-scraper

Extract comprehensive preprint data from medRxiv, including titles, authors, abstracts, full text, DOIs, citations, and metadata. Automate access to health-science preprints with structured outputs, ideal for researchers and analysts who need reliable, large-scale article data without manual work.

ParseForge

ArXiv Preprint Paper Search

ryanclinton/arxiv-paper-search

Search and extract preprint research papers from the ArXiv open-access repository. Query over 2.4 million academic papers across physics, mathematics, computer science, biology, economics, and more with structured JSON output, no API key required.

ryan clinton

arXiv Paper Scraper

plantane/arxiv-scraper

Scrape research papers from arXiv by search query or category. Get titles, abstracts, authors, categories, and PDF links via the public arXiv API.

Daniel

Academic Paper Scraper

constant_quadruped/academic-paper-scraper

Search arXiv and PubMed in one request. Returns unified paper data: titles, authors, abstracts, DOIs, and PDF links. Filter by keywords, authors, categories, and date range. Built-in rate limiting and cross-source deduplication. Export to JSON, CSV, or Excel.

Arxiv Paper Scraper

technicaldost/arxiv-paper-scraper

Technical Dost Solutions

arXiv Paper Scraper

cloud9_ai/arxiv-paper-scraper

Scrape academic papers from arXiv.org. Search by keyword, browse categories, or get latest papers. Extract titles, abstracts, authors, PDF links, and citation data via arXiv API.

cloud9

PubMed Search Scraper

easyapi/pubmed-search-scraper

Scrape research papers and academic articles from PubMed based on search terms. Extract comprehensive article metadata including titles, authors, citations, abstracts, and more. Perfect for medical research and literature reviews.

EasyApi

Arxiv Keyword Spider

getdataforme/arxiv-keyword-spider

Arxiv Keyword Spider efficiently scrapes arXiv.org for research papers using keywords, delivering comprehensive metadata like titles, authors, abstracts, and categories. Perfect for academic research, market analysis, and trend monitoring....