bioRxiv & medRxiv Preprints Scraper (Biology, Health) avatar

bioRxiv & medRxiv Preprints Scraper (Biology, Health)

Pricing

from $7.56 / 1,000 preprint records

Go to Apify Store
bioRxiv & medRxiv Preprints Scraper (Biology, Health)

bioRxiv & medRxiv Preprints Scraper (Biology, Health)

Scrape bioRxiv and medRxiv preprints by date, category or keyword: title, authors, corresponding institution, abstract, DOI, license, published-journal status and AI summary. Export to JSON, CSV or Excel.

Pricing

from $7.56 / 1,000 preprint records

Rating

0.0

(0)

Developer

Scrapers Lat

Scrapers Lat

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 days ago

Last modified

Share

bioRxiv & medRxiv Preprints Scraper (Biology, Health)

bioRxiv & medRxiv Preprints Scraper (Biology, Health)

Here is one real result, with every field the actor returns:

{
"server": "biorxiv",
"doi": "10.1101/2023.03.29.534823",
"title": "Hydrogel Capsule-Based Digital Quantitative Polymerase Chain Reaction",
"authors": "Tan, Z. L.; Yasuura, M.; Horiguchi, Y.; Ashiba, H.; Fukuda, T.",
"authorList": ["Tan, Z. L.", "Yasuura, M.", "Horiguchi, Y.", "Ashiba, H.", "Fukuda, T."],
"authorCount": 5,
"correspondingAuthor": "Takashi Fukuda",
"correspondingInstitution": "Sensing System Research Center, National Institute of Advanced Industrial Science and Technology, Central 5, 1-1-1 Higashi, Tsukuba, Ibaraki, 305-8565, Japan",
"postedDate": "2023-04-27",
"version": 2,
"type": "new results",
"category": "molecular biology",
"license": "cc_no",
"abstract": "Droplet digital PCR (ddPCR) is accurate in nucleic acid quantification owing to its linearity and high sensitivity ...",
"preprintUrl": "https://www.biorxiv.org/content/10.1101/2023.03.29.534823v2",
"isPublished": true,
"publishedDoi": "10.1007/s00604-023-05827-7",
"publishedJournal": "Microchimica Acta",
"publishedJournalDoi": "10.1007/s00604-023-05827-7",
"publishedDate": "2023-06-01",
"aiPlainSummary": "This research introduces a new method for digital PCR that uses hydrogel capsules instead of droplets, making the process more stable and sensitive.",
"aiSignificance": "This method enhances the accessibility and effectiveness of digital PCR, especially in resource-limited settings.",
"aiField": "molecular biology",
"aiMethods": "gel capsule-based digital PCR (gc-dPCR)",
"source": "bioRxiv / medRxiv preprint servers",
"observedAt": "2026-08-20T22:30:41.983Z",
"error": null
}

The most complete bioRxiv and medRxiv preprint scraper available. It returns every field the preprint servers expose for each paper (title, full author list, corresponding author and institution, abstract, subject category, license, version and DOI), plus a joined published-journal status so you know whether and where each preprint later appeared in a peer-reviewed journal, an optional AI plain-language read, and five filters to target exactly the preprints you need.

📥 Input · 📤 Output · 💰 Pricing · ▶️ Examples

Apify Coverage Output Billing

Table of contents

What it does

The actor pulls preprints from bioRxiv (biology) and medRxiv (health sciences). Give it a posted-date range on one or both servers, or a single DOI, and it returns one clean record per preprint. Each preprint is deduplicated to its latest version, the abstract is cleaned, and the author string is also split into an array with an author count. Optional category and keyword filters are applied so you keep only the papers you care about.

Every record carries the published-journal status: isPublished and publishedDoi tell you whether the preprint was later published in a peer-reviewed journal and give the journal article DOI. Turn on the published-status add-on to also resolve the journal name and publication date. Turn on the AI add-on for a plain-English summary, a significance line, the field, and the methods used.

Coverage is bioRxiv and medRxiv only. For already-published, indexed literature see the related scrapers below (PubMed, Crossref, OpenAlex, Semantic Scholar).

Quickstart

Open the actor, paste this into the input, and press Run. It returns up to 8 neuroscience preprints posted on bioRxiv in the first week of 2025.

{
"server": "biorxiv",
"dateFrom": "2025-01-01",
"dateTo": "2025-01-07",
"category": "neuroscience",
"maxResults": 8
}

Set server to medrxiv for health-sciences preprints, or both to scan both servers in one run. Leave category and searchTerm empty to get every preprint in the date range. To look up a single paper, pass its doi and the date range is ignored.

Input reference

FieldTypeRequiredDescription
serverenumnoWhich preprint server to scrape: biorxiv (biology), medrxiv (health sciences), or both. Default biorxiv.
dateFromstringnoStart of the posted-date range (inclusive), YYYY-MM-DD. Required unless a doi is set. Example 2025-01-01.
dateTostringnoEnd of the posted-date range (inclusive), YYYY-MM-DD. Required unless a doi is set. Example 2025-01-07.
categorystringnoKeep only preprints whose subject category contains this text. Case-insensitive substring match. Example neuroscience, genomics, infectious diseases.
searchTermstringnoKeep only preprints whose title or abstract contains this text. Case-insensitive substring match.
doistringnoLook up one preprint by DOI, for example 10.1101/2023.03.29.534823. When set, the date range and filters are ignored and one record (latest version) is returned.
withPublishedStatusbooleannoAdd-on. Resolve the journal name, published DOI, and publication date for preprints later published in a journal. Off by default, paid plans only. Billed per preprint only when a real mapping is found.
withAiSummarybooleannoAdd-on. Add an AI plain-language summary, significance, field, and methods per preprint. Off by default, paid plans only. Billed per preprint only when a usable summary is produced.
maxResultsintegernoMaximum preprints to return in one run. Free Apify plans are capped at 10. Default 10.

Output reference

One dataset item per preprint. Types are string, integer, boolean, string[], or null when a value is absent.

FieldTypeDescription
serverstringPreprint server: biorxiv or medrxiv.
doistringPreprint DOI.
titlestringPreprint title.
authorsstringFull author list as a semicolon-separated string.
authorListstring[]Authors split into an array.
authorCountintegerNumber of authors.
correspondingAuthorstringCorresponding author name.
correspondingInstitutionstringCorresponding author institution.
postedDatestringDate the latest version was posted (YYYY-MM-DD).
versionintegerPreprint version number (latest kept).
typestringPreprint type, for example new results.
categorystringSubject category.
licensestringLicense, for example cc_by, cc_no.
abstractstringCleaned abstract text.
preprintUrlstringPublic preprint page URL.
isPublishedbooleanWhether the preprint was later published in a journal.
publishedDoistringDOI of the published journal article, or null.
publishedJournalstringPublished journal name. Populated by the published-status add-on.
publishedJournalDoistringPublished journal article DOI. Populated by the published-status add-on.
publishedDatestringJournal publication date. Populated by the published-status add-on.
aiPlainSummarystringAI plain-English summary. Populated by the AI add-on.
aiSignificancestringAI why-it-matters line. Populated by the AI add-on.
aiFieldstringAI-identified field or subfield. Populated by the AI add-on.
aiMethodsstringAI-identified methods or study design. Populated by the AI add-on.
sourcestringData source label.
observedAtstringISO 8601 timestamp of when the record was collected.
errorstringnull on success. On a failed or empty lookup a single item with a populated error field is written instead.

Example output record

Real record from a live run (input {"server":"biorxiv","dateFrom":"2025-01-01","dateTo":"2025-01-07","category":"neuroscience","maxResults":8}):

{
"server": "biorxiv",
"doi": "10.1101/2025.01.02.631090",
"title": "State-dependent modulation of spiny projection neurons controls levodopa-induced dyskinesia",
"authors": "Zhai, S.; Cui, Q.; Wokosin, D.; Sun, L.; Tkatch, T.; Crittenden, J. R.; Graybiel, A. M.; Surmeier, D. J.",
"authorCount": 8,
"correspondingAuthor": "Dalton James Surmeier",
"correspondingInstitution": "Northwestern University",
"postedDate": "2025-01-07",
"version": 2,
"type": "new results",
"category": "neuroscience",
"license": "cc_by",
"preprintUrl": "https://www.biorxiv.org/content/10.1101/2025.01.02.631090v2",
"isPublished": true,
"publishedDoi": "10.1126/sciadv.adv8224",
"publishedJournal": null,
"aiPlainSummary": null,
"source": "bioRxiv / medRxiv preprint servers",
"observedAt": "2026-08-20T22:26:46.737Z",
"error": null
}

Run via API and CLI

Start a run and read the dataset. Replace <TOKEN> with your Apify API token.

Run synchronously and get dataset items in one call:

curl -X POST "https://api.apify.com/v2/acts/scrapers_lat~biorxiv-medrxiv-preprints-scraper/run-sync-get-dataset-items?token=<TOKEN>" \
-H "Content-Type: application/json" \
-d '{"server":"medrxiv","dateFrom":"2024-06-01","dateTo":"2024-06-03","maxResults":25}'

Start a run asynchronously:

curl -X POST "https://api.apify.com/v2/acts/scrapers_lat~biorxiv-medrxiv-preprints-scraper/runs?token=<TOKEN>" \
-H "Content-Type: application/json" \
-d '{"server":"both","dateFrom":"2025-01-01","dateTo":"2025-01-07","searchTerm":"cancer","maxResults":100}'

Apify CLI:

apify call scrapers_lat/biorxiv-medrxiv-preprints-scraper \
--input '{"doi":"10.1101/2023.03.29.534823","withPublishedStatus":true}'

Fetch results

Every run writes to a dataset. Fetch items as JSON, CSV, or Excel by changing format:

# JSON
curl "https://api.apify.com/v2/datasets/<DATASET_ID>/items?token=<TOKEN>&clean=true&format=json"
# CSV
curl "https://api.apify.com/v2/datasets/<DATASET_ID>/items?token=<TOKEN>&clean=true&format=csv"
# Paginate large datasets
curl "https://api.apify.com/v2/datasets/<DATASET_ID>/items?token=<TOKEN>&offset=1000&limit=1000"

<DATASET_ID> is returned as defaultDatasetId in the run object. Use offset and limit to page through large result sets.

Billing and limits

  • Pay per result. You are charged per preprint returned (result event). See the pricing tab for the current per-result price.
  • Opt-in add-ons. withPublishedStatus bills only when a real published-journal mapping is found. withAiSummary bills only when a usable AI summary is produced. Both are off by default and disabled for free Apify plans.
  • No charge on failure. If a lookup errors or matches nothing, the actor writes a single item with a populated error field and does not charge for it. Empty runs cost nothing.
  • Spend cap respected. Set maxTotalChargeUsd on the run; once reached, the actor stops emitting and charging further billable results.
  • Free Apify plans are capped at 10 preprints per run and cannot use the paid add-ons. Upgrade for higher maxResults.

FAQ and troubleshooting

What is the difference between this and a PubMed or Crossref scraper? This actor reads the bioRxiv and medRxiv preprint servers directly, so you get papers at the preprint stage, often months before journal publication. PubMed, Crossref, OpenAlex, and Semantic Scholar index already-published literature. This actor also joins the two worlds: it tells you whether and where each preprint was later published.

A date-range run returned 0 records. Why? The category or keyword filter matched nothing in that window, or no preprints were posted in the range. Widen the date range, or remove category and searchTerm. Zero-result runs are not charged.

How does version handling work? Preprints can have several versions. The actor keeps the latest version per DOI and reports its version number and postedDate.

Why is publishedJournal null even though isPublished is true? isPublished and publishedDoi come from the base record for free. The journal name and publication date are resolved by the withPublishedStatus add-on. Turn it on to populate publishedJournal, publishedJournalDoi, and publishedDate. Journal resolution covers preprints published within the scanned window and may be partial for very old preprints.

Can I scan both servers at once? Yes. Set server to both. Each record is tagged with the server it came from.

Is this an official bioRxiv or medRxiv tool? No. This actor is independent and has no affiliation with bioRxiv, medRxiv, or Cold Spring Harbor Laboratory. It reads only publicly available preprint metadata. Use it in accordance with the source terms of service.

More scrapers at scrapers.lat

Built and maintained by scrapers.lat, where we publish scrapers for public platforms: company registries, government data, finance, research, e-commerce and more. Browse the catalog or request a custom scraper at scrapers.lat.


Independent tool, not affiliated with bioRxiv, medRxiv, or Cold Spring Harbor Laboratory. Accesses only publicly available preprint metadata. Use in accordance with the source terms of service.