Europe Pmc Literature Scraper

Europe PMC Scraper for Biomedical Literature and PubMed Articles

Search and extract peer-reviewed biomedical literature, preprints, and PubMed records directly from Europe PMC. BigiByte's Europe PMC Scraper pulls article titles, author strings, journal details, open access flags, and citation counts into clean, structured datasets—saving you from manual database queries and pagination.

---

What Does This Scraper Do?

Europe PMC provides comprehensive access to life sciences literature, combining published journal articles and preprint archives into a single index. This tool helps researchers, clinical teams, and academic librarians quickly gather targeted literature lists into clean tabular formats.

Key Use Cases

• Literature Reviews: Pull articles for specific research topics (e.g., malaria, oncology, immunology) with complete author strings and journal metadata in a single dataset.
• Open Access Auditing: Track open access status (isOpenAccess), PubMed Central flags (inPMC), and full-text availability alongside document DOIs.
• Citation Tracking: Extract citation counts (citedByCount) when available to measure impact and prioritize reading lists.
• Research Operations: Export capped batches of structured records straight into your data notebooks or local storage.
• Scheduled Refreshes: Automate periodic data collection runs to keep your reference lists current without manual intervention.

---

Input Parameters

Parameter	Type	Default	Description
mode	String	search	Defines the operation mode.
query	String	malaria	The search term or query string to match against records (e.g., malaria, AUTH:Smith).
resultType	String	lite	Detail level of results: lite or core.
maxItems	Integer	100	Maximum number of successful rows to collect (capped at 1,000).
timeoutSecs	Integer	300	Overall execution timeout in seconds.
requestTimeoutSecs	Integer	30	Timeout per network request in seconds.
proxyConfiguration	Object	(off)	Optional proxy. Leave off by default; enable Apify Proxy only if requests are blocked.

Example Input

{
  "mode": "search",
  "query": "malaria",
  "resultType": "lite",
  "maxItems": 100,
  "timeoutSecs": 300,
  "requestTimeoutSecs": 30
}

---

Extracted Output Data

Each saved dataset row contains complete article metadata and open access indicators:

{
  "id": "42575118",
  "source": "MED",
  "pmid": "42575118",
  "doi": "10.1016/j.langlo.2026.103984",
  "articleTitle": "Long-term mortality and risk of chronic kidney disease in children following severe malaria complicated by acute kidney injury...",
  "authorString": "Mellencamp KA, Namazzi R, Batte A, Kazinga C, Liepmann CD, Goings MJ, Opoka RO, Datta D, Ren J, Kalyesubula R, Bangirana P, Goldstein SL, Jo...",
  "journalTitle": "Lancet Glob Health",
  "pubYear": "2027",
  "journalIssn": "2214-109x",
  "pageInfo": "103984",
  "pubType": "journal article",
  "isOpenAccess": "N",
  "inEPMC": "N",
  "inPMC": "N",
  "scrapedAt": "2026-10-12T00:00:00Z"
}

Output Field Reference

Field	Type	Description
id	String	Unique Europe PMC record ID (duplicate IDs are automatically filtered out).
source	String	Source database code (e.g., MED for PubMed).
pmid	String	PubMed ID associated with the article.
doi	String	Digital Object Identifier for the publication.
articleTitle	String	Title of the research article.
authorString	String	Formatted string containing the list of authors.
journalTitle	String	Name of the publishing journal.
pubYear	String	Year of publication.
journalIssn	String	ISSN of the publishing journal.
pageInfo	String	Page numbers or article identifier numbers.
pubType	String	Publication classification type.
isOpenAccess	String	Flag indicating open access status (Y or N).
inEPMC / inPMC	String	Availability flags for Europe PMC and PubMed Central full text.
citedByCount	Integer	Citation count (included when returned by the record).
scrapedAt	String	UTC timestamp indicating when the item was collected.
error	String	Populated only if a specific request encounters an issue, ensuring the task continues running smoothly.

---

How Data Collection Works

• Optimized Cursor Pagination: Pages through results sequentially using robust cursor tracking to retrieve complete result sets up to your item cap.
• Automatic Deduplication: Duplicate record IDs are automatically filtered out to keep your dataset clean and unique.
• Resilient Retries: Built-in network error handling manages transient rate limits or server timeouts smoothly without crashing the entire run.
• Flexible Export: Download your collected research datasets anytime in JSON, CSV, or Excel formats.

---

Related Tools & Custom Development

If you plan to map, cross-reference, or join biomedical literature records with external institutional datasets, quick CSV cleanups or metadata enrichment passes are standard next steps. BigiByte builds custom data scrapers, research feeds, and automated monitoring pipelines for academic institutions, medical libraries, and scientific publishers worldwide.

Need custom scheduled monitoring, specialized database integration, or tailored data pipelines? BigiByte builds custom scrapers tailored to your project: https://bigibyte.com

---

Frequently Asked Questions

How many articles can I extract per run?

maxItems defaults to 100 records and can be adjusted up to a hard cap of 1,000 successful items per run.

Can I export my data directly to CSV or Excel?

Yes! Once a task completes, you can export the full dataset directly to JSON, CSV, or Excel format.

Why are some fields like citation counts missing on certain records?

Lite search results omit certain extended metadata fields unless specifically populated by the record. Switching to core results or checking specific records ensures maximum metadata coverage.

---

Trademark Notice & Disclaimer

Trademark Notice: Europe PMC and related names, logos, and trademarks belong to their respective owners. Their use in this documentation is solely to identify the source of data and does not imply affiliation, sponsorship, endorsement, or partnership.

Disclaimer: This tool is an independent solution developed by BigiByte and is not officially affiliated with, endorsed by, or sponsored by Europe PMC. All data is collected from publicly accessible records. Users are responsible for adhering to the source's terms of service, rate limits, and licensing requirements.

---

Is Web Scraping Legal?

This tool collects publicly available biomedical literature metadata. While extracting public records is standard practice, consider the following best practices:

• Personal Data: Author names and professional profiles constitute public research data. Ensure compliance with applicable privacy regulations (such as GDPR or CCPA) if storing or processing personal information.
• Copyright & Reuse: Abstract texts and publication records remain subject to copyright. Respect attribution requirements and reuse limitations specified by publishers and authors.
• Legal Context: This information provides general context and does not constitute legal advice.

To learn more, read Apify's guide: Is web scraping legal?