PubMed Scraper — Biomedical Research Papers avatar

PubMed Scraper — Biomedical Research Papers

Pricing

from $0.50 / 1,000 results

Go to Apify Store
PubMed Scraper — Biomedical Research Papers

PubMed Scraper — Biomedical Research Papers

Scrape biomedical research papers from PubMed via the NCBI E-utilities API. Search by keyword with optional date range, retrieve article metadata, abstracts, authors, MeSH terms, and DOIs. Supports both summary (fast) and full (with abstract) retrieval modes.

Pricing

from $0.50 / 1,000 results

Rating

0.0

(0)

Developer

Joren Maurissen

Joren Maurissen

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a day ago

Last modified

Share

Search and scrape biomedical research papers from PubMed using the NCBI E-utilities API. No API key required — the NCBI E-utilities are free and open.

Features

  • Keyword search with PubMed query syntax support (e.g. CRISPR gene editing, cancer AND immunotherapy)
  • Two retrieval modes:
    • Summary (fast): title, authors, journal, publication date, DOI, pub type, language
    • Full (detailed): everything in summary + abstract, MeSH terms, ISSN, publication year
  • Date range filtering (e.g. 2020:2026) to narrow results by publication date
  • Sort by relevance or date — use PubMed's native ranking or get the most recent papers
  • Structured output — clean JSON records ready for analysis, with PubMed URLs for each article
  • Rate-limit aware — respects NCBI's 3 requests/second guideline

Input

FieldTypeRequiredDefaultDescription
searchTermstringcancerPubMed search query (supports full PubMed syntax)
maxResultsinteger20Maximum articles to retrieve (1–10,000)
retTypeselectsummarysummary (fast) or full (with abstracts + MeSH terms)
sortselectrelevancerelevance or date (most recent first)
dateRangestringPublication date range, e.g. 2020:2026

Output

Each article is pushed as a JSON record to the dataset:

Summary mode fields

FieldDescription
pmidPubMed Unique Identifier
titleArticle title
authorsAuthor names (semicolon-separated)
journalJournal abbreviation/source
pubDatePublication date
epubDateElectronic publication date
doiDigital Object Identifier
pubTypePublication type(s)
langLanguage(s)
urlPubMed URL for the article
scrapedAtISO timestamp of scrape

Full mode adds

FieldDescription
abstractFull abstract text
issnISSN
pubYearPublication year
meshTermsMeSH subject headings (semicolon-separated)

Example Input

{
"searchTerm": "CRISPR gene editing",
"maxResults": 50,
"retType": "full",
"sort": "date",
"dateRange": "2023:2026"
}

Use Cases

  • Literature reviews — batch-download article metadata for systematic reviews
  • Research monitoring — track new publications in your field by date range
  • Bibliometric analysis — extract author lists, MeSH terms, and publication patterns
  • Data enrichment — get DOIs and PubMed URLs for reference management
  • AI/ML training data — build datasets of biomedical abstracts for NLP tasks

Technical Details

This actor uses the NCBI E-utilities API:

  • esearch.fcgi — searches PubMed and returns PMIDs
  • esummary.fcgi — fetches document summaries (summary mode)
  • efetch.fcgi — fetches full XML records parsed with BeautifulSoup (full mode)

No authentication required. The actor respects NCBI's rate limit guideline (≤3 requests/second).

Pricing

Pay per result — you only pay for the articles actually returned in the dataset.