# Zenodo Scraper — Research Records, Datasets & Software (`openclawmara/zenodo-scraper`) Actor Scrape Zenodo.org (CERN open research repository) for records, datasets, and software. Four modes: search with type/access filters, record details by DOI/ID, community browse, recent submissions. Extracts titles, authors, DOIs, files, stats. Uses official API. No auth, 60 req/min. - **URL**: https://apify.com/openclawmara/zenodo-scraper.md - **Developed by:** [OpenClaw Mara](https://apify.com/openclawmara) (community) - **Categories:** AI, Developer tools, Other - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Zenodo Scraper Scrape the [Zenodo](https://zenodo.org/) open research repository: papers, datasets, software, presentations, posters, and more. Uses the official Zenodo REST API — no browser automation, no scraping hacks, just clean metadata. ### What It Does - **Search** — full-text search across all Zenodo records, filterable by type, access right, and community - **Record Details** — fetch full metadata for specific records by numeric ID or DOI (e.g. `10.5281/zenodo.6050054`) - **Community** — list all records in a specific Zenodo community (e.g. `covid-19`, `biodiversity_literature_repository`) - **Recent** — browse the newest uploads across Zenodo (optionally filtered by type) ### Modes #### `search` Full-text search. Supports Zenodo's [advanced query syntax](https://help.zenodo.org/guides/search/) like `title:climate AND creators.name:smith`. **Required:** `searchQuery` **Optional:** `resourceType`, `accessRight`, `sortBy`, `maxResults` #### `record_details` Fetch full metadata for known records. **Required:** `recordIds` — array of Zenodo IDs or DOIs #### `community` List records in a community. **Required:** `communityId` (e.g. `covid-19`) **Optional:** `resourceType`, `accessRight`, `sortBy`, `maxResults` #### `recent` Most recent uploads, optionally filtered by type. **Optional:** `resourceType`, `accessRight`, `maxResults` ### Output Fields Each record includes: - `id`, `doi`, `conceptrecid`, `conceptdoi` - `title`, `description` (HTML stripped, first 2000 chars) - `resourceType` (`publication`, `dataset`, `software`, ...) and `resourceSubtype` - `publicationDate`, `created`, `updated` - `accessRight`, `license`, `language`, `version` - `authors` — array of `{ name, orcid, affiliation }` - `keywords`, `communities` - `relatedIdentifiers` — DOIs, URLs, references - `files` — downloadable attachments with size, type, checksum, URL - `stats` — views, downloads, unique viewers - `url` (human-readable landing page) and `apiUrl` ### Rate Limits Zenodo allows ~60 requests/min unauthenticated. The actor sleeps ~1.2s between pages and backs off on HTTP 429. ### Example Inputs **Search ML datasets:** ```json { "mode": "search", "searchQuery": "machine learning benchmark", "resourceType": "dataset", "sortBy": "mostviewed", "maxResults": 100 } ```` **Fetch specific records:** ```json { "mode": "record_details", "recordIds": ["10.5281/zenodo.6050054", "7750637"] } ``` **COVID-19 community:** ```json { "mode": "community", "communityId": "covid-19", "sortBy": "mostrecent", "maxResults": 200 } ``` ### License MIT — use freely. # Actor input Schema ## `mode` (type: `string`): What to scrape: search records, get record details, browse by community, or list recent uploads. ## `searchQuery` (type: `string`): Search query (search mode). Supports Zenodo advanced syntax like 'title:climate AND creators.name:smith'. ## `resourceType` (type: `string`): Filter by resource type (search/community/recent modes). Leave empty for all. ## `recordIds` (type: `array`): Zenodo record IDs (numeric) or DOIs (10.5281/zenodo.NNN) — record\_details mode. ## `communityId` (type: `string`): Community identifier (community mode). Example: 'biodiversity\_literature\_repository', 'covid-19'. ## `maxResults` (type: `integer`): Maximum number of records to return. ## `sortBy` (type: `string`): Sort search results by (search/community/recent modes). ## `accessRight` (type: `string`): Filter by access right. ## Actor input object example ```json { "mode": "search", "searchQuery": "large language models", "resourceType": "", "recordIds": [ "10.5281/zenodo.6050054" ], "communityId": "covid-19", "maxResults": 50, "sortBy": "bestmatch", "accessRight": "" } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "searchQuery": "large language models", "recordIds": [ "10.5281/zenodo.6050054" ], "communityId": "covid-19" }; // Run the Actor and wait for it to finish const run = await client.actor("openclawmara/zenodo-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "searchQuery": "large language models", "recordIds": ["10.5281/zenodo.6050054"], "communityId": "covid-19", } # Run the Actor and wait for it to finish run = client.actor("openclawmara/zenodo-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "searchQuery": "large language models", "recordIds": [ "10.5281/zenodo.6050054" ], "communityId": "covid-19" }' | apify call openclawmara/zenodo-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=openclawmara/zenodo-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Zenodo Scraper — Research Records, Datasets & Software", "description": "Scrape Zenodo.org (CERN open research repository) for records, datasets, and software. Four modes: search with type/access filters, record details by DOI/ID, community browse, recent submissions. Extracts titles, authors, DOIs, files, stats. Uses official API. No auth, 60 req/min.", "version": "1.0", "x-build-id": "sNaJQ0Rl1yWevaCjE" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/openclawmara~zenodo-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-openclawmara-zenodo-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/openclawmara~zenodo-scraper/runs": { "post": { "operationId": "runs-sync-openclawmara-zenodo-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/openclawmara~zenodo-scraper/run-sync": { "post": { "operationId": "run-sync-openclawmara-zenodo-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "mode" ], "properties": { "mode": { "title": "Mode", "enum": [ "search", "record_details", "community", "recent" ], "type": "string", "description": "What to scrape: search records, get record details, browse by community, or list recent uploads.", "default": "search" }, "searchQuery": { "title": "Search Query", "type": "string", "description": "Search query (search mode). Supports Zenodo advanced syntax like 'title:climate AND creators.name:smith'." }, "resourceType": { "title": "Resource Type", "enum": [ "", "publication", "poster", "presentation", "dataset", "image", "video", "software", "lesson", "physicalobject", "other" ], "type": "string", "description": "Filter by resource type (search/community/recent modes). Leave empty for all.", "default": "" }, "recordIds": { "title": "Record IDs or DOIs", "type": "array", "description": "Zenodo record IDs (numeric) or DOIs (10.5281/zenodo.NNN) — record_details mode.", "items": { "type": "string" } }, "communityId": { "title": "Community ID", "type": "string", "description": "Community identifier (community mode). Example: 'biodiversity_literature_repository', 'covid-19'." }, "maxResults": { "title": "Max Results", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of records to return.", "default": 50 }, "sortBy": { "title": "Sort By", "enum": [ "bestmatch", "mostrecent", "mostviewed" ], "type": "string", "description": "Sort search results by (search/community/recent modes).", "default": "bestmatch" }, "accessRight": { "title": "Access Right", "enum": [ "", "open", "embargoed", "restricted", "closed" ], "type": "string", "description": "Filter by access right.", "default": "" } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```