Dryad Research Datasets Scraper
Pricing
from $7.50 / 1,000 results
Dryad Research Datasets Scraper
Scrapes Dryad dataset metadata by free-text query or affiliation ROR ID. Returns each dataset as a flat row with DOI, title, abstract, authors, keywords, and publication dates.
Pricing
from $7.50 / 1,000 results
Rating
0.0
(0)
Developer
ParseForge
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
11 days ago
Last modified
Categories
Share
Dryad Research Datasets Scraper
Scrape research dataset metadata from Dryad by search term or affiliation, up to a million per run. Every dataset comes with its DOI, title, abstract, authors, keywords, and publication dates. Export to CSV, JSON, Excel, or XML.
Finding open research datasets across disciplines means searching Dryad's repository manually or writing code against its API. This Actor reads the public dataset listings directly, filtered by free-text query or institutional affiliation, and returns each match in one fixed schema.
| Who uses it | What they scrape Dryad for |
|---|---|
| Academic researchers | Finding datasets to reuse for a literature review or meta-analysis |
| Data librarians | Building a catalog of open datasets published by their institution |
| Research data managers | Monitoring dataset publication output across affiliated labs |
| Science journalists | Discovering recently published data behind emerging studies |
What it does
This Actor collects Dryad research dataset metadata by search term or affiliation ROR ID, and returns each dataset as a flat row.
- ๐ Free-text search: filter datasets by any keyword, topic, or phrase.
- ๐๏ธ Affiliation filter: restrict results to datasets from a specific institution using its ROR ID.
- ๐ฆ Bulk collection: set a high maxItems and pull thousands of dataset records in one run.
- ๐ Flat row output: each dataset lands as one row with DOI, title, abstract, authors, keywords, and dates.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with Dryad data
๐ Build a disciplinary dataset catalog.
A data librarian runs the Actor with a topic query and collects every matching Dryad dataset with its DOI and abstract for a subject guide.
๐๏ธ Track institutional research output.
A research office feeds their university's ROR ID and pulls all recently published datasets to populate an annual report.
๐ฌ Find data for a systematic review.
A graduate student searches Dryad by keyword, exports the results, and screens titles and abstracts for eligible studies.
๐ Monitor data publication trends.
A metascience researcher collects datasets by affiliation over time to analyze open data sharing patterns.
Why choose this scraper
| What you get | |
|---|---|
| DOI | Persistent identifier for every dataset |
| Title and abstract | Full descriptive metadata for relevance screening |
| Authors and keywords | Attribution and subject tagging |
| Publication dates | Know when the data was released |
How it compares
This Actor and the alternative Dryad Datasets Scraper both collect metadata from Dryad, but they differ in filtering options and the input schema they expose.
| Feature | ParseForge | Dryad Datasets Scraper - Research Data Metadata |
|---|---|---|
| Free-text search query | Yes | Not listed |
| Affiliation filter by ROR ID | Yes | Not listed |
| Configurable max items per run | Yes | Not listed |
| Returns dataset DOI | Yes | Yes |
| Returns author list | Yes | Yes |
Configure the run
Drive the Actor with a free-text query, an affiliation ROR ID, or both together, and set a maximum number of datasets to collect. The Input tab lists every parameter.
A first run with the defaults:
A larger pull:
Pricing
Pay-per-result: $0.0085 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $0.85 |
| 1,000 results | $8.50 |
| 10,000 results | $85.00 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the Dryad Research Datasets Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to Dryad through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Check that your query or affiliation ROR ID is spelled correctly. Try a broader search term first, then narrow down. Also confirm that Dryad itself returns results for the same search in a browser.
The Actor stops before reaching my maxItems.
Dryad may have fewer matching datasets than your maxItems value. The Actor collects every available match and stops when the listing is exhausted.
Some fields are empty in my results.
Not every Dryad dataset includes all metadata fields. Authors, keywords, or abstracts may be missing when the depositor did not supply them.
I got blocked or the Actor is returning errors.
The Actor includes polite delays between requests. If you are running many concurrent instances, reduce the frequency or increase the run interval.
How do I find my institution's ROR ID?
Visit ror.org and search for your institution by name. The ROR ID is a URL like https://ror.org/0123456789. Use the full URL in the affiliation input.
FAQ
| Question | Answer |
|---|---|
| What is Dryad? | Dryad is an open data publishing platform where researchers share datasets underlying peer-reviewed articles across all disciplines. |
| Do I need a Dryad account or API key? | No. This Actor reads the public dataset listings and requires no login, account, or API key. |
| What metadata fields does the Actor return? | Each row includes the dataset DOI, title, abstract, author list, keywords, and publication date, among other fields from the listing. |
| How do I filter by institution? | Use the affiliation input with a ROR ID, the persistent identifier for research organizations. You can find your institution's ROR ID at ror.org. |
| Can I combine a search term and an affiliation filter? | Yes. Provide both a query and an affiliation ROR ID, and the Actor returns datasets matching both criteria. |
| How many datasets can I collect in one run? | Set maxItems up to 1,000,000. The Actor stops when it reaches that count or when Dryad has no more matching datasets. |
| What export formats are supported? | You can export your results to CSV, JSON, Excel, or XML from the Apify dataset tab. |
| Does this Actor download the actual data files? | No. It collects the metadata describing each dataset. The actual data files remain on Dryad and can be accessed via the DOI link. |
| Is this Actor affiliated with Dryad? | No. This is an independent scraper that reads publicly available pages on Dryad. It is not built or endorsed by Dryad. |
| Can I schedule this Actor to run regularly? | Yes. Use Apify's scheduler to run it daily, weekly, or on any cron schedule to track new dataset publications. |
Related actors
Browse the full ParseForge collection for more scrapers.
๐ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
โ ๏ธ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Dryad. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
