re3data Research Data Repositories Scraper
Pricing
from $4.52 / 1,000 results
re3data Research Data Repositories Scraper
Scrapes repository records from re3data.org by name or keyword and returns each one as a flat row with its metadata, subjects, and institutional details.
Pricing
from $4.52 / 1,000 results
Rating
0.0
(0)
Developer
ParseForge
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
6 days ago
Last modified
Categories
Share
re3data Research Data Repositories Scraper
Scrape research data repository metadata from the re3data.org registry, up to a million per run. Every record includes the repository name, URL, subjects, content types, and institutional details. Export to CSV, JSON, Excel, or XML.
re3data.org is the global registry of research data repositories, but browsing or searching it manually makes systematic comparison slow. This Actor reads the public registry, filters by repository name or keyword, and returns each match in one fixed schema so you can analyze the landscape offline.
| Who uses it | What they scrape re3data for |
|---|---|
| Research data librarians | Build a local catalog of subject-specific repositories for their institution. |
| Data stewards | Identify compliant repositories for a data management plan. |
| Open science analysts | Map the global infrastructure of research data repositories by discipline. |
| Repository managers | Benchmark their own repository's metadata against peers in the registry. |
What it does
This Actor collects repository records from re3data.org by name or keyword and returns each one as a flat row.
- 🔍 Keyword filter: supply a repository name or a term like 'genome' to fetch only matching records.
- 📋 Full registry walk: leave the search term empty to collect every repository in re3data.
- ⚙️ Volume control: set a hard cap on the number of repositories returned per run.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with re3data data
📚 Build a subject-specific repository shortlist.
A research data librarian searches for 'archaeology' and exports the results to share with the department as a vetted list of places to deposit data.
🗺️ Map the open science landscape.
An analyst scrapes the full registry to count repositories by country and subject, feeding a report on global research infrastructure.
📝 Populate a data management plan tool.
A data steward runs the Actor for a keyword like 'oceanography' and uses the structured output to suggest compliant repositories to researchers.
🔬 Monitor new repository registrations.
A repository manager schedules a weekly run with no filter to capture newly added entries in the re3data registry.
Why choose this scraper
| What you get | |
|---|---|
| Repository name | The official name of the research data repository. |
| Repository URL | The homepage link for the repository. |
| Subjects | The academic disciplines the repository covers. |
| Content types | The kinds of data the repository accepts, such as raw data or source code. |
| Institution | The responsible institution and its country. |
How it compares
No other Store actor targets re3data the same way, so the honest comparison is with the alternatives teams actually weigh.
| re3data Research Data Repositories Scraper | Build it in-house | By hand | |
|---|---|---|---|
| Setup | Run it now, zero config | Days of engineering | None, but hours per pull |
| When re3data changes | Maintained for you | You fix it | You re-learn the page |
| Proxies, retries, anti-bot | Built in | Your problem | Browser only |
| Output | Fixed JSON schema, CSV/Excel export | Whatever you build | Copy-paste |
| Cost | Pay per result | Engineering time | Analyst hours |
Configure the run
Drive the Actor with an optional repository name or keyword, and set a maximum number of records to collect. The Input tab lists every parameter.
A first run with the defaults:
A larger pull:
Pricing
Pay-per-result: $0.005 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $0.50 |
| 1,000 results | $5.00 |
| 10,000 results | $50.00 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the re3data Research Data Repositories Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to re3data through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Check your search term spelling. Try a broader keyword or leave the search term empty to confirm the registry is reachable.
The run stopped before collecting all repositories.
Increase the 'Maximum repositories' value. The Actor stops when it reaches this number, even if more records exist.
Some fields are empty in my dataset.
Not every repository supplies every metadata field. Empty cells mean re3data.org does not list that information for that repository.
The run timed out.
Lower the 'Maximum repositories' value and run the Actor in batches, or increase the run timeout in your Apify account settings.
FAQ
| Question | Answer |
|---|---|
| What is re3data.org? | re3data.org is a global registry of research data repositories that indexes their services, policies, and institutional details to help researchers find places to deposit data. |
| Can I scrape the entire re3data registry? | Yes. Leave the search term empty and set a high maximum items number to walk the full registry. |
| How do I filter for a specific subject? | Enter a subject keyword like 'genomics' or 'social sciences' in the search term field. The Actor filters repository names that contain that text. |
| What output formats are supported? | You can export the dataset to CSV, JSON, Excel, or XML from the Apify dataset tab. |
| Does this Actor require an API key for re3data? | No. It reads the public re3data.org pages directly and does not need a login or API key. |
| How often is the re3data registry updated? | The registry is maintained continuously by its editors. Run this Actor on a schedule to capture new or changed entries. |
| Can I search for a specific repository by name? | Yes. Type the exact repository name, such as 'Zenodo' or 'Dryad', into the search term field. |
| What metadata fields does the Actor return? | It returns the repository name, URL, subjects, content types, institution, country, and other descriptive metadata available on the re3data detail page. |
| Is there a rate limit I should worry about? | The Actor runs at a polite speed. If you need to scrape the full registry, a single run works without hitting aggressive rate limits. |
Related actors
Browse the full ParseForge collection for more scrapers.
🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by re3data.org. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
