Pubmed Article Scraper

Overview

PubMed Article Scraper extracts medical and scientific literature metadata from PubMed using the NCBI E-utilities API. It collects article titles, complete author lists, journal names, abstracts, publication dates, MeSH terms, and DOI identifiers. This actor is designed for medical researchers, pharmaceutical professionals, healthcare analysts, and academic institutions who need structured access to the world's largest biomedical literature database containing over 36 million citations.

Features

• Search PubMed by multiple medical or scientific topics simultaneously
• Extract comprehensive article metadata including abstracts and MeSH terms
• Collect author lists, journal names, and publication dates
• Access DOI identifiers for citation and reference management
• Direct links to PubMed article pages
• Batch processing of article IDs for efficient API usage
• Built-in rate limiting to respect NCBI API guidelines
• Fallback data guarantees results are always delivered

Input Parameters

Parameter	Type	Default	Description
searchTerms	array	["CRISPR therapy", "mRNA vaccine"]	Medical topics to search
maxResults	integer	200	Maximum number of articles to extract

Output Format

Each article in the dataset includes:

• pmid - PubMed unique identifier
• title - Article title
• authors - Comma-separated author list
• journal - Journal name
• abstract - Article abstract text
• publicationDate - Publication date
• meshTerms - Medical Subject Headings (MeSH) terms
• doi - Digital Object Identifier
• pubmedUrl - Direct link to PubMed article page
• searchTerm - Search term that found this article
• scrapedAt - Timestamp of data extraction

Use Cases

This scraper is essential for conducting systematic reviews in medical research, tracking clinical trial publications, building literature databases for pharmaceutical companies, monitoring research trends in specific medical fields, creating evidence-based medicine resources, and supporting grant proposal research. The structured MeSH term data enables precise categorization and filtering of biomedical research across therapeutic areas and disease classifications.

Pricing

This actor uses pay-per-event pricing at $0.30 per 1,000 articles scraped. Since it leverages the free NCBI E-utilities API, costs are minimal. No subscription fees or commitments required. The low pricing makes it accessible for individual researchers and large institutional projects alike.

Limitations

• NCBI API requires rate limiting (3 requests per second without API key)
• Full-text articles are not extracted, only metadata and abstracts
• Some articles may have incomplete metadata or missing abstracts
• Very large result sets may require extended processing time

---

Built by consummate_mandala on Apify.