# Bioconductor Scraper (`crawlerbros/bioconductor-scraper`) Actor Scrape Bioconductor R package metadata - title, description, biocViews categories, author, maintainer, license, dependencies, and more. Search by keyword or biocViews category, or fetch specific packages by name. - **URL**: https://apify.com/crawlerbros/bioconductor-scraper.md - **Developed by:** [Crawler Bros](https://apify.com/crawlerbros) (community) - **Categories:** Developer tools, Automation - **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: No ratings yet ## Pricing from $3.00 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## Bioconductor Scraper Scrape [Bioconductor](https://bioconductor.org/) R package metadata. Search packages by keyword, filter by biocViews category (e.g. "RNASeq", "Sequencing", "Microarray"), or fetch specific packages by name — get version, title, description, author, maintainer, license, dependencies, and more. ### Features - **Search packages** by keyword across name, title, and description - **Filter by biocViews** category (e.g. "RNASeq", "GenomicData", "Sequencing") - **Fetch specific packages** by exact name - Extracts: name, version, title, description, biocViews, author, maintainer, license, depends, imports, suggests, URL, bug report link - Uses official Bioconductor JSON API — no authentication required - Covers the full Bioconductor release repository (2,000+ packages) ### Input | Field | Type | Description | Default | |-------|------|-------------|---------| | `mode` | String (select) | `searchPackages` or `getByName` | `searchPackages` | | `searchQuery` | String | Keyword search in name/title/description | `RNA-seq` | | `packageNames` | Array of strings | Exact package names for `getByName` mode | `[]` | | `biocViews` | String | Filter by biocViews category | _(none)_ | | `maxItems` | Integer (1–1000) | Maximum number of records to return | `10` | #### Mode: searchPackages Search Bioconductor packages whose name, title, or description contains the query string (case-insensitive). Optionally combine with a biocViews filter. **Example input:** ```json { "mode": "searchPackages", "searchQuery": "RNA-seq", "maxItems": 20 } ```` **With biocViews filter:** ```json { "mode": "searchPackages", "biocViews": "Sequencing", "maxItems": 50 } ``` #### Mode: getByName Fetch specific packages by their exact Bioconductor package name (case-insensitive). **Example input:** ```json { "mode": "getByName", "packageNames": ["DESeq2", "edgeR", "limma"], "maxItems": 10 } ``` ### Output Each record contains: | Field | Type | Description | |-------|------|-------------| | `packageName` | String | Bioconductor package name | | `version` | String | Current release version | | `title` | String | Short package title | | `description` | String | Full package description | | `biocViews` | Array | Bioconductor category tags | | `author` | String | Package author(s) with roles | | `maintainer` | String | Current maintainer with email | | `license` | String | License type | | `depends` | Array | Hard dependencies | | `imports` | Array | Imported packages | | `suggests` | Array | Optional suggested packages | | `vignettes` | Array | Vignette builder tools | | `url` | String | Project URL | | `bugReports` | String | Bug tracker URL | | `sourceUrl` | String | Bioconductor package page URL | | `recordType` | String | Always `"package"` | | `scrapedAt` | String | ISO 8601 timestamp | #### Sample Output Record ```json { "packageName": "DESeq2", "version": "1.42.0", "title": "Differential gene expression analysis based on the negative binomial distribution", "description": "Estimate variance-mean dependence in count data from RNA-Seq experiments, and test for differential expression based on a model using the negative binomial distribution.", "biocViews": ["RNASeq", "Sequencing", "DifferentialExpression", "GeneExpression", "Transcriptomics"], "author": "Michael Love [aut, cre], Simon Anders [aut], Wolfgang Huber [aut]", "maintainer": "Michael Love ", "license": "LGPL (>= 3)", "depends": ["R", "S4Vectors", "IRanges", "GenomicRanges", "SummarizedExperiment"], "imports": ["BiocGenerics", "Biobase", "locfit", "ggplot2"], "suggests": ["knitr", "rmarkdown", "testthat"], "vignettes": ["knitr"], "url": "https://github.com/thelovelab/DESeq2", "bugReports": "https://github.com/thelovelab/DESeq2/issues", "sourceUrl": "https://bioconductor.org/packages/release/bioc/html/DESeq2.html", "recordType": "package", "scrapedAt": "2026-05-30T12:00:00+00:00" } ``` ### Data Source Data is sourced from the official [Bioconductor packages JSON API](https://bioconductor.org/packages/json/3.18/bioc/packages.json). No authentication is required. ### biocViews Categories Common biocViews categories you can use as filters: - `RNASeq` — RNA sequencing analysis - `Sequencing` — Next-generation sequencing - `Microarray` — Microarray data analysis - `GenomicData` — Genomic data representation - `Infrastructure` — Core infrastructure packages - `DifferentialExpression` — Differential expression analysis - `Proteomics` — Proteomics data - `Metabolomics` — Metabolomics data - `SingleCell` — Single-cell RNA sequencing - `Epigenetics` — Epigenetic data analysis - `VariantAnnotation` — Genetic variant annotation ### FAQs **Q: How many Bioconductor packages are available?** A: The Bioconductor release repository contains over 2,200 software packages. **Q: What Bioconductor version does this use?** A: The actor scrapes the current release (3.18). Data includes packages from `bioconductor.org/packages/release/bioc/`. **Q: Can I search across multiple biocViews categories?** A: The `biocViews` filter accepts one category at a time. Use `searchQuery` for broader keyword searches. **Q: Are annotation and experiment packages included?** A: The actor focuses on the main software package repository. Annotation and experiment data packages are not included. **Q: What does "depends" vs "imports" vs "suggests" mean?** A: These are standard R package dependency levels. `depends` are hard dependencies loaded on attach; `imports` are used internally; `suggests` are optional extras for examples or vignettes. **Q: Why are version constraints removed from dependency lists?** A: The actor strips version constraints (e.g. `R (>= 4.0)`) to provide clean package name lists. The full constraint information is in the package description page. # Actor input Schema ## `mode` (type: `string`): What to fetch: search packages by keyword/category, or get specific packages by exact name. ## `searchQuery` (type: `string`): Keyword to search in package name, title, or description (mode=searchPackages). ## `packageNames` (type: `array`): List of exact Bioconductor package names to fetch (mode=getByName), e.g. \["DESeq2", "edgeR", "limma"]. ## `biocViews` (type: `string`): Filter by biocViews category (e.g. "Sequencing", "GenomicData", "Microarray", "RNASeq"). Case-insensitive exact match. ## `maxItems` (type: `integer`): Maximum number of package records to return. ## Actor input object example ```json { "mode": "searchPackages", "searchQuery": "RNA-seq", "maxItems": 10 } ``` # Actor output Schema ## `packages` (type: `string`): Dataset containing all scraped Bioconductor package records. # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "mode": "searchPackages", "searchQuery": "RNA-seq", "maxItems": 10 }; // Run the Actor and wait for it to finish const run = await client.actor("crawlerbros/bioconductor-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "mode": "searchPackages", "searchQuery": "RNA-seq", "maxItems": 10, } # Run the Actor and wait for it to finish run = client.actor("crawlerbros/bioconductor-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "mode": "searchPackages", "searchQuery": "RNA-seq", "maxItems": 10 }' | apify call crawlerbros/bioconductor-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crawlerbros/bioconductor-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Bioconductor Scraper", "description": "Scrape Bioconductor R package metadata - title, description, biocViews categories, author, maintainer, license, dependencies, and more. Search by keyword or biocViews category, or fetch specific packages by name.", "version": "1.0", "x-build-id": "bU0lruUzewVhfVKbC" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crawlerbros~bioconductor-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crawlerbros-bioconductor-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crawlerbros~bioconductor-scraper/runs": { "post": { "operationId": "runs-sync-crawlerbros-bioconductor-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crawlerbros~bioconductor-scraper/run-sync": { "post": { "operationId": "run-sync-crawlerbros-bioconductor-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "mode" ], "properties": { "mode": { "title": "Mode", "enum": [ "searchPackages", "getByName" ], "type": "string", "description": "What to fetch: search packages by keyword/category, or get specific packages by exact name.", "default": "searchPackages" }, "searchQuery": { "title": "Search query", "type": "string", "description": "Keyword to search in package name, title, or description (mode=searchPackages)." }, "packageNames": { "title": "Package names (mode=getByName)", "type": "array", "description": "List of exact Bioconductor package names to fetch (mode=getByName), e.g. [\"DESeq2\", \"edgeR\", \"limma\"].", "items": { "type": "string" } }, "biocViews": { "title": "biocViews category filter", "type": "string", "description": "Filter by biocViews category (e.g. \"Sequencing\", \"GenomicData\", \"Microarray\", \"RNASeq\"). Case-insensitive exact match." }, "maxItems": { "title": "Max items", "minimum": 1, "maximum": 1000, "type": "integer", "description": "Maximum number of package records to return.", "default": 100 } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```