# NCI GDC Project Summary Scraper (`acquistion-automation/nci-gdc-project-summary-scraper`) Actor

Scrapes NCI Genomic Data Commons project summaries from the public API. Returns each project's ID, name, primary cancer site, case count, and file count as a flat row.

- **URL**: https://apify.com/acquistion-automation/nci-gdc-project-summary-scraper.md
- **Developed by:** [Acquisition Automation Co.](https://apify.com/acquistion-automation) (community)
- **Categories:** Other
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $3.62 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

[![Acquisition Automation](https://api.apify.com/v2/key-value-stores/AOdPHdOpeDpzEPS5f/records/banner.jpg)](https://apify.com/acquistion-automation)

### NCI GDC Project Summary Scraper

**Scrape NCI GDC project summaries with case counts, file counts, and primary sites from the public API.** Returns structured project metadata for every released cancer study. No login or API key required. Export to CSV, JSON, Excel, or XML.

The NCI Genomic Data Commons portal renders project lists in JavaScript, making direct scraping unreliable. This Actor reads the public GDC API endpoint directly, returning every released project's summary in a flat, consistent schema. Filter by primary cancer site to narrow results to a specific disease area.

| Who uses it | What they scrape NCI Genomic Data Commons for |
|---|---|
| Cancer researchers | Catalog available genomic studies for a specific cancer type. |
| Bioinformaticians | Build an index of GDC projects and their data volumes for pipeline planning. |
| Data journalists | Gather case-count statistics across cancer projects for reporting. |
| Clinical trial coordinators | Identify GDC projects with sufficient case counts for cohort analysis. |

### What it does

This Actor collects NCI GDC project summaries from the public API and returns each project as a flat row with its ID, name, primary site, case count, and file count.

- **Primary site filter:** Narrow results to a single cancer site like Lung, Breast, or Brain.
- **Summary counts:** Each row includes case\_count and file\_count from the project summary.
- **Bulk export:** Pull up to 10 project summaries in one run and export to CSV, JSON, Excel, or XML.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

### What you can do with NCI Genomic Data Commons data

**Catalog studies by cancer type.**

A cancer researcher filters GDC projects by primary site 'Lung' to list every lung cancer study with its case and file counts.

**Monitor data growth across projects.**

A bioinformatics platform runs the Actor weekly to track file\_count changes in all released GDC projects.

**Gather statistics for a cancer report.**

A data journalist pulls all GDC project summaries to compare case counts across the most-studied cancer sites.

### Why choose this scraper

| | What you get |
|---|---|
| **No API key** | The GDC public API requires no authentication or registration. |
| **Structured output** | Every project returns the same flat schema: ID, name, primary site, case count, file count. |
| **Site filter** | Restrict results to one cancer type instead of downloading all projects. |
| **Scalable** | Paid users can pull up to one million project summaries per run. |

### What a NCI Genomic Data Commons record looks like

Every record returns as one flat JSON row. Here is a real one from a run:

```json
{
 "id": "TCGA-LUAD",
 "projectId": "TCGA-LUAD",
 "name": "Lung Adenocarcinoma",
 "caseCount": 585,
 "fileCount": 36740,
 "scrapedAt": "2026-09-26T03:08:45.298Z"
}
```

Every value above comes from a real run. A field a record does not have comes back as `null`.

### Configure the run

Drive the Actor with an optional primary site filter and a max items limit. Filtering runs as each project is read so only matching cancer sites reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

```json
{
 "maxItems": 10
}
```

A larger pull:

```json
{
 "maxItems": 200
}
```

### Free users

Free-plan runs return up to 10 results as a preview. [Upgrade your Apify plan](https://console.apify.com/sign-up) to collect up to 1,000,000 results per run.

### Run it

1. [Create a free Apify account](https://console.apify.com/sign-up).
2. Open the [NCI GDC Project Summary Scraper](https://apify.com/acquistion-automation/nci-gdc-project-summary-scraper).
3. Set your inputs and any filters, then click **Start**.
4. Export the results as CSV, Excel, JSON, or XML from the **Dataset** tab.

Run it programmatically through the [Apify API](https://docs.apify.com/api/v2) (`run-sync-get-dataset-items`) or the [ApifyClient](https://docs.apify.com/api/client/js) for JavaScript and Python.

### Use with AI agents (MCP)

Give an AI agent live access to NCI Genomic Data Commons through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

```bash
claude mcp add --transport http apify "https://mcp.apify.com?tools=acquistion-automation/nci-gdc-project-summary-scraper"
```

Then prompt it in plain language to run the scraper and read back the results.

### Troubleshooting

**Why am I getting no results?**

Check your primary site filter spelling. The API matches exact site names like 'Lung', 'Breast', or 'Brain'. Try leaving the filter empty to see all projects first.

**Why does the run stop at 10 items?**

Free Apify users are limited to 10 items. Upgrade to a paid plan and increase the maxItems input to pull more projects.

**Why are some projects missing from the results?**

The Actor only returns projects where released=true. Unreleased or embargoed projects are excluded by the API.

**Why did I get a timeout or empty response?**

The GDC API may occasionally be slow. Retry the run. If the problem persists, reduce maxItems or contact support.

### FAQ

| Question | Answer |
|---|---|
| Do I need an API key or GDC account? | No. The GDC public API is open and requires no authentication. This Actor calls it directly. |
| What fields does each row contain? | Each row returns the id, projectId, name, primarySite, caseCount, fileCount, scrapedAt, and error for a released GDC project. |
| Can I filter by cancer type? | Yes. Use the Primary Site Filter input to restrict results to a single site such as Lung, Breast, or Brain. |
| How many projects can I scrape in one run? | Free users are limited to 10 items for preview. Paid users can set maxItems up to 1,000,000. |
| Is the data real-time? | The Actor calls the live GDC API on each run, so you always receive the current project summaries. |
| What export formats are supported? | You can export the dataset to CSV, JSON, Excel, or XML from the Apify platform. |
| Does this scrape the GDC portal HTML? | No. The portal is a JavaScript application with no embedded data. This Actor reads the underlying public API directly. |
| Can I get project-level metadata beyond case and file counts? | This Actor focuses on the summary fields. For full project details, you would need a different endpoint or custom Actor. |

### Related actors

Browse the full [Acquisition Automation collection](https://apify.com/acquistion-automation) for more scrapers.

🆘 **Need help?** Open an issue in the Issues tab of this Actor with your run ID, your input, and what you expected.

### Pricing

This Actor uses **pay-per-result** pricing: **$0.004 per result** collected. You are billed only for the results you receive, so a run that returns nothing costs nothing.

⚠️ **Disclaimer.** This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by National Cancer Institute. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

# Actor input Schema

## `maxItems` (type: `integer`):

Free users: Limited to 10 items (preview). Paid users: Optional, max 1,000,000

## `primarySiteFilter` (type: `string`):

Filter projects by primary cancer site, e.g. Lung, Breast, Brain. Leave empty for all sites.

## Actor input object example

```json
{
  "maxItems": 10
}
```

# Actor output Schema

## `results` (type: `string`):

Complete dataset of all scraped records.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "maxItems": 10
};

// Run the Actor and wait for it to finish
const run = await client.actor("acquistion-automation/nci-gdc-project-summary-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "maxItems": 10 }

# Run the Actor and wait for it to finish
run = client.actor("acquistion-automation/nci-gdc-project-summary-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "maxItems": 10
}' |
apify call acquistion-automation/nci-gdc-project-summary-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,acquistion-automation/nci-gdc-project-summary-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/EhycgbHofVcINrUZK/builds/AfVqPFdkVXezMnX0F/openapi.json