PubMed Scraper — Biomedical Research Papers
Pricing
from $0.50 / 1,000 results
PubMed Scraper — Biomedical Research Papers
Scrape biomedical research papers from PubMed via the NCBI E-utilities API. Search by keyword with optional date range, retrieve article metadata, abstracts, authors, MeSH terms, and DOIs. Supports both summary (fast) and full (with abstract) retrieval modes.
Pricing
from $0.50 / 1,000 results
Rating
0.0
(0)
Developer
Joren Maurissen
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
a day ago
Last modified
Categories
Share
Search and scrape biomedical research papers from PubMed using the NCBI E-utilities API. No API key required — the NCBI E-utilities are free and open.
Features
- Keyword search with PubMed query syntax support (e.g.
CRISPR gene editing,cancer AND immunotherapy) - Two retrieval modes:
- Summary (fast): title, authors, journal, publication date, DOI, pub type, language
- Full (detailed): everything in summary + abstract, MeSH terms, ISSN, publication year
- Date range filtering (e.g.
2020:2026) to narrow results by publication date - Sort by relevance or date — use PubMed's native ranking or get the most recent papers
- Structured output — clean JSON records ready for analysis, with PubMed URLs for each article
- Rate-limit aware — respects NCBI's 3 requests/second guideline
Input
| Field | Type | Required | Default | Description |
|---|---|---|---|---|
searchTerm | string | ✅ | cancer | PubMed search query (supports full PubMed syntax) |
maxResults | integer | 20 | Maximum articles to retrieve (1–10,000) | |
retType | select | summary | summary (fast) or full (with abstracts + MeSH terms) | |
sort | select | relevance | relevance or date (most recent first) | |
dateRange | string | — | Publication date range, e.g. 2020:2026 |
Output
Each article is pushed as a JSON record to the dataset:
Summary mode fields
| Field | Description |
|---|---|
pmid | PubMed Unique Identifier |
title | Article title |
authors | Author names (semicolon-separated) |
journal | Journal abbreviation/source |
pubDate | Publication date |
epubDate | Electronic publication date |
doi | Digital Object Identifier |
pubType | Publication type(s) |
lang | Language(s) |
url | PubMed URL for the article |
scrapedAt | ISO timestamp of scrape |
Full mode adds
| Field | Description |
|---|---|
abstract | Full abstract text |
issn | ISSN |
pubYear | Publication year |
meshTerms | MeSH subject headings (semicolon-separated) |
Example Input
{"searchTerm": "CRISPR gene editing","maxResults": 50,"retType": "full","sort": "date","dateRange": "2023:2026"}
Use Cases
- Literature reviews — batch-download article metadata for systematic reviews
- Research monitoring — track new publications in your field by date range
- Bibliometric analysis — extract author lists, MeSH terms, and publication patterns
- Data enrichment — get DOIs and PubMed URLs for reference management
- AI/ML training data — build datasets of biomedical abstracts for NLP tasks
Technical Details
This actor uses the NCBI E-utilities API:
- esearch.fcgi — searches PubMed and returns PMIDs
- esummary.fcgi — fetches document summaries (summary mode)
- efetch.fcgi — fetches full XML records parsed with BeautifulSoup (full mode)
No authentication required. The actor respects NCBI's rate limit guideline (≤3 requests/second).
Pricing
Pay per result — you only pay for the articles actually returned in the dataset.