Dryad Research Datasets Scraper
Pricing
from $19.00 / 1,000 results
Dryad Research Datasets Scraper
Scrapes Dryad research datasets by search term and returns each dataset as a flat row with DOI, title, abstract, authors, keywords, and publication dates.
Pricing
from $19.00 / 1,000 results
Rating
0.0
(0)
Developer
ParseForge
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
9 days ago
Last modified
Share
Dryad Research Datasets Scraper
Scrape Dryad research datasets by search term, up to a million per run. Every dataset comes with its DOI, title, abstract, authors, keywords, and publication dates. No login or API key. Export to CSV, JSON, Excel, or XML.
Dryad's official API requires registration and rate limits you. This reads the public dataset search results directly, filtered by your search term, and returns each match in one fixed schema. It is built for researchers, librarians, and data analysts who need research data metadata at scale.
| Who uses it | What they scrape Dryad for |
|---|---|
| Researchers | Find datasets in their field for literature review or meta-analysis |
| Librarians | Build a catalog of open research data for their institution |
| Data analysts | Gather metadata for trend analysis or data quality assessment |
| Journal publishers | Monitor datasets associated with published articles |
What it does
This Actor collects Dryad research datasets by search term and returns each one as a flat row with its DOI, title, abstract, authors, keywords, and publication dates.
- 🔍 Search by term: pass any free-text query and get matching datasets.
- 📄 Rich metadata: DOI, title, abstract, authors, keywords, and publication dates for each dataset.
- 📊 Scalable: collect up to 1,000,000 datasets per run for paid users.
- 💾 Multiple exports: save results as CSV, JSON, Excel, or XML.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with Dryad data
📚 Build a research data catalog.
A librarian runs the Actor with a broad search term like 'ecology' to collect metadata for all matching datasets and import them into the institutional repository.
📈 Track dataset publication trends.
A data analyst runs the Actor weekly with a field-specific query to monitor how many new datasets are published and which topics are trending.
🔗 Find datasets for a literature review.
A researcher runs the Actor with keywords from their review topic to gather all relevant datasets and their DOIs for citation.
🧪 Monitor data sharing compliance.
A journal publisher runs the Actor with article titles to verify that authors have deposited their data in Dryad.
Why choose this scraper
| What you get | |
|---|---|
| No API key | No registration or OAuth, run the Actor |
| Complete metadata | DOI, title, abstract, authors, keywords, and publication dates |
| Flexible search | Any free-text query, from broad topics to specific titles |
| Scalable | Up to 1,000,000 datasets per run for paid users |
How it compares
This Actor offers a straightforward search-based approach to Dryad metadata, while the competitor focuses on recent datasets without search filtering.
| Feature | ParseForge | Dryad Datasets Scraper - Research Data Metadata |
|---|---|---|
| Search by term | Yes | Not listed |
| Collect recent datasets | Not listed | Yes |
| DOI | Yes | Yes |
| Title | Yes | Yes |
| Abstract | Yes | Yes |
| Authors | Yes | Yes |
| Keywords | Yes | Yes |
| Publication dates | Yes | Yes |
| Canonical links | Not listed | Yes |
Configure the run
Drive the Actor with a search term, and set a maximum number of datasets to collect. The search runs as each dataset is read so only matches reach your dataset. The Input tab lists every parameter.
A first run with the defaults:
A larger pull:
Pricing
Pay-per-result: $0.021 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $2.10 |
| 1,000 results | $21.00 |
| 10,000 results | $210.00 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the Dryad Research Datasets Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to Dryad through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Check your search term. Try a broader term or remove special characters. Also ensure that the maximum datasets limit is not set too low.
Why am I only getting 10 results?
Free users are limited to 10 items as a preview. Upgrade to a paid plan to collect more datasets.
The Actor is taking too long.
Reduce the maximum datasets limit or narrow your search term to speed up the run.
Some fields are empty in the results.
Not all datasets have complete metadata. Empty fields are normal for datasets that lack that information.
I get an error when exporting to Excel.
Try exporting to CSV or JSON instead. If the problem persists, check the dataset size and reduce the number of items.
FAQ
| Question | Answer |
|---|---|
| Do I need a Dryad API key? | No. This Actor scrapes the public Dryad search pages directly, so no registration or API key is required. |
| What metadata does each dataset include? | Each dataset row includes its DOI, title, abstract, authors, keywords, and publication dates. |
| Can I search for a specific dataset? | Yes. Use the search term input to enter a title, author, or keyword, and the Actor will return matching datasets. |
| How many datasets can I collect? | Free users are limited to 10 items as a preview. Paid users can collect up to 1,000,000 datasets per run. |
| What formats can I export the results to? | You can export the results as CSV, JSON, Excel, or XML. |
| Is the data from Dryad open access? | Yes, Dryad is an open data repository, and all datasets are publicly available. |
| Can I filter by publication date? | The Actor returns publication dates for each dataset, but filtering by date is not currently supported. You can filter the results after export. |
| Does this Actor download the actual data files? | No, it only collects metadata. To download the data files, you would need to follow the DOI link for each dataset. |
| Is this Actor suitable for large-scale harvesting? | Yes, paid users can collect up to 1,000,000 datasets per run, making it suitable for large-scale metadata harvesting. |
| Can I run this Actor on a schedule? | Yes, you can schedule runs in Apify to collect new datasets automatically at regular intervals. |
Related actors
Browse the full ParseForge collection for more scrapers.
🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by Dryad Digital Repository. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
