# USGS ScienceBase Catalog Scraper (`parseforge/usgs-protected-areas-scraper`) Actor

Scrapes USGS ScienceBase Catalog records by search query, parent item ID, or browse category. Returns each record as a flat row with title, URL, and metadata.

- **URL**: https://apify.com/parseforge/usgs-protected-areas-scraper.md
- **Developed by:** [ParseForge](https://apify.com/parseforge) (community)
- **Categories:** Automation, Other
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $0.90 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.
Since this Actor supports Apify Store discounts, the price gets lower the higher subscription plan you have.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

[![ParseForge](https://raw.githubusercontent.com/ParseForge/apify-assets/main/banner.jpg)](https://apify.com/parseforge?fpr=vmoqkp)

### USGS ScienceBase Catalog Scraper

**Scrape USGS ScienceBase Catalog records by search query, parent item, or browse category, up to a million per run.** Each record comes with its title, URL, and metadata as a flat row. No login or API key. Export to CSV, JSON, Excel, or XML.

The USGS ScienceBase Catalog holds authoritative records for datasets, maps, and publications, but its web interface is built for browsing one item at a time. This Actor reads the public catalog search directly, filtered by query, parent item ID, or browse category, and returns each matching record in one fixed schema.

| Who uses it | What they scrape USGS ScienceBase Catalog for |
|---|---|
| GIS analysts | Gathering metadata for datasets in a study area |
| Environmental consultants | Compiling available USGS data for a project site |
| Academic researchers | Building a bibliography of USGS publications on a topic |
| Data journalists | Finding USGS datasets behind a story |

### What it does

This Actor collects USGS ScienceBase Catalog records by search query, parent item ID, or browse category, and returns each one as a flat row.

- 🔍 **Search query:** free-text search across catalog titles, abstracts, and tags.
- 📁 **Parent item ID:** scope results to children of a known ScienceBase item.
- 🗂️ **Browse category:** filter by categories like Data, Map, or Publication.
- 📊 **Flat rows:** every record returns as one row with consistent fields.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

### What you can do with USGS ScienceBase Catalog data

**🗺️ Build a dataset inventory.**

A GIS analyst searches for all ScienceBase records matching a watershed name and exports the metadata to plan data acquisition.

**📚 Compile a publication list.**

A researcher uses a parent item ID to pull every child record from a USGS project and formats the titles and URLs as a bibliography.

**📊 Monitor new data releases.**

A data journalist runs a weekly query for a browse category like Data and checks for new USGS datasets on a topic.

**🔎 Audit metadata coverage.**

An environmental consultant pulls all records under a parent item to verify which datasets are publicly available for a site assessment.

### Why choose this scraper

|  | What you get |
|---|---|
| **No API key** | Uses the public ScienceBase catalog search, no registration needed |
| **Flexible scoping** | Combine query, parent ID, and category to narrow results |
| **Scalable** | From a 10-record preview to a million records per run |
| **Structured output** | Flat rows ready for CSV, JSON, Excel, or XML |

### How it compares

This Actor focuses on flexible search and filtering of the USGS ScienceBase Catalog, while the competitors listed below target either a different field set or a specific USGS data product.

| Feature | ParseForge | USGS Sciencebase Scraper | USGS Mineral Commodity Summaries Scraper |
|---|---|---|---|
| Search by free-text query | Yes | Not listed | Not listed |
| Filter by parent item ID | Yes | Not listed | Not listed |
| Filter by browse category | Yes | Not listed | Not listed |
| Set maximum records | Yes, up to 1,000,000 | Not listed | Not listed |
| Export to CSV, JSON, Excel, XML | Yes | Yes | Not listed |
| Returns title and URL | Yes | Yes | Not listed |

### Configure the run

Drive the Actor from a search query, a parent item ID, or a browse category, alone or together, and set a maximum number of records to return. The Input tab lists every parameter.

A first run with the defaults:

```json
{
  "maxItems": 10
}
```

A larger pull:

```json
{
  "maxItems": 200
}
```

### Pricing

Pay-per-result: **$0.001 per result** collected. You pay only for the results written to your dataset.

| Results collected | Approximate cost |
|---|---|
| 100 results | $0.10 |
| 1,000 results | $1.00 |
| 10,000 results | $10.00 |

New Apify accounts start with $5 in free credit.

### Free users

Free-plan runs return up to 10 results as a preview. [Upgrade your Apify plan](https://console.apify.com/sign-up?fpr=vmoqkp) to collect up to 1,000,000 results per run.

### Run it

1. [Create a free Apify account with $5 in credit](https://console.apify.com/sign-up?fpr=vmoqkp).
2. Open the [USGS ScienceBase Catalog Scraper](https://apify.com/parseforge/usgs-protected-areas-scraper?fpr=vmoqkp).
3. Set your inputs and any filters, then click **Start**.
4. Export the results as CSV, Excel, JSON, or XML from the **Dataset** tab.

Run it programmatically through the [Apify API](https://docs.apify.com/api/v2) (`run-sync-get-dataset-items`) or the [ApifyClient](https://docs.apify.com/api/client/js) for JavaScript and Python.

### Use with AI agents (MCP)

Give an AI agent live access to USGS ScienceBase Catalog through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

```bash
claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/usgs-protected-areas-scraper"
```

Then prompt it in plain language to run the scraper and read back the results.

### Troubleshooting

**Why am I getting no results?**

Check that your search query is not too restrictive. Try removing the parent item ID or browse category, or use a broader query. Also verify that the parent item ID is correct.

**Why did the run stop at 10 records?**

Free users are limited to a 10-record preview. Upgrade to a paid plan to increase maxItems up to 1,000,000.

**Why are some records missing fields?**

The catalog search may not return every metadata field for every record. Use the record's URL to open the full ScienceBase item for complete metadata.

**Can I get the full metadata for a record?**

This Actor returns the fields from the catalog search result. For full metadata, fetch the record's URL directly from ScienceBase.

**Why did the run time out?**

If you set a very high maxItems, the run may take longer. Try reducing maxItems or increasing the Actor's timeout in the run settings.

### FAQ

| Question | Answer |
|---|---|
| Do I need a USGS API key? | No. This Actor uses the public ScienceBase catalog search, so no registration or key is required. |
| What is a parent item ID? | It is the ScienceBase identifier for a container item, such as a project or collection. Providing it returns only records that are children of that item. |
| Can I combine search query and browse category? | Yes. All input fields are optional and can be used together. The Actor applies them as filters to the catalog search. |
| What is the maximum number of records? | Free users can preview up to 10 records. Paid users can set maxItems up to 1,000,000. |
| What output formats are supported? | The Actor returns structured data that can be exported to CSV, JSON, Excel, or XML from the Apify platform. |
| Does it return full metadata for each record? | It returns the fields available from the catalog search result, including title, URL, and other standard metadata. For full metadata, use the record's URL to fetch the complete ScienceBase item. |
| Can I search by geographic location? | The input schema does not include a geographic filter. You can use a search query with place names or use a parent item ID that represents a geographic area. |
| Is this an official USGS tool? | No, this is a third-party scraper built on the public ScienceBase catalog search. It is not affiliated with or endorsed by the U.S. Geological Survey. |
| How often is the data updated? | The Actor reads the live catalog at run time, so results reflect the current state of ScienceBase. |
| Can I schedule this Actor to run regularly? | Yes, you can set up a schedule in Apify to run it daily, weekly, or at any interval. |

### Related actors

Browse the full [ParseForge collection](https://apify.com/parseforge?fpr=vmoqkp) for more scrapers.

🆘 **Need help?** Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ **Disclaimer.** This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by U.S. Geological Survey. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.

# Actor input Schema

## `query` (type: `string`):

Optional free-text search query for catalog items.

## `parentId` (type: `string`):

Optional ScienceBase parent item ID to scope the search.

## `browseCategory` (type: `string`):

Optional browse category filter, for example Data.

## `maxItems` (type: `integer`):

Free users limited to 10 catalog items preview. Paid users optional up to 1000000.

## Actor input object example

```json
{
  "maxItems": 10
}
```

# Actor output Schema

## `results` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "maxItems": 10
};

// Run the Actor and wait for it to finish
const run = await client.actor("parseforge/usgs-protected-areas-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = { "maxItems": 10 }

# Run the Actor and wait for it to finish
run = client.actor("parseforge/usgs-protected-areas-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "maxItems": 10
}' |
apify call parseforge/usgs-protected-areas-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,parseforge/usgs-protected-areas-scraper"
        }
    }
}

```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/FcEAVr2sTUVPmow06/builds/LcYvZV6YxKevcwtvZ/openapi.json
