USGS ScienceBase Catalog Scraper
Pricing
from $0.90 / 1,000 results
USGS ScienceBase Catalog Scraper
Scrapes USGS ScienceBase Catalog records by search query, parent item ID, or browse category. Returns each record as a flat row with title, URL, and metadata.
Pricing
from $0.90 / 1,000 results
Rating
0.0
(0)
Developer
ParseForge
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
2 days ago
Last modified
Categories
Share
USGS ScienceBase Catalog Scraper
Scrape USGS ScienceBase Catalog records by search query, parent item, or browse category, up to a million per run. Each record comes with its title, URL, and metadata as a flat row. No login or API key. Export to CSV, JSON, Excel, or XML.
The USGS ScienceBase Catalog holds authoritative records for datasets, maps, and publications, but its web interface is built for browsing one item at a time. This Actor reads the public catalog search directly, filtered by query, parent item ID, or browse category, and returns each matching record in one fixed schema.
| Who uses it | What they scrape USGS ScienceBase Catalog for |
|---|---|
| GIS analysts | Gathering metadata for datasets in a study area |
| Environmental consultants | Compiling available USGS data for a project site |
| Academic researchers | Building a bibliography of USGS publications on a topic |
| Data journalists | Finding USGS datasets behind a story |
What it does
This Actor collects USGS ScienceBase Catalog records by search query, parent item ID, or browse category, and returns each one as a flat row.
- 🔍 Search query: free-text search across catalog titles, abstracts, and tags.
- 📁 Parent item ID: scope results to children of a known ScienceBase item.
- 🗂️ Browse category: filter by categories like Data, Map, or Publication.
- 📊 Flat rows: every record returns as one row with consistent fields.
Results export to CSV, JSON, Excel, or XML, or straight from the API.
What you can do with USGS ScienceBase Catalog data
🗺️ Build a dataset inventory.
A GIS analyst searches for all ScienceBase records matching a watershed name and exports the metadata to plan data acquisition.
📚 Compile a publication list.
A researcher uses a parent item ID to pull every child record from a USGS project and formats the titles and URLs as a bibliography.
📊 Monitor new data releases.
A data journalist runs a weekly query for a browse category like Data and checks for new USGS datasets on a topic.
🔎 Audit metadata coverage.
An environmental consultant pulls all records under a parent item to verify which datasets are publicly available for a site assessment.
Why choose this scraper
| What you get | |
|---|---|
| No API key | Uses the public ScienceBase catalog search, no registration needed |
| Flexible scoping | Combine query, parent ID, and category to narrow results |
| Scalable | From a 10-record preview to a million records per run |
| Structured output | Flat rows ready for CSV, JSON, Excel, or XML |
How it compares
This Actor focuses on flexible search and filtering of the USGS ScienceBase Catalog, while the competitors listed below target either a different field set or a specific USGS data product.
| Feature | ParseForge | USGS Sciencebase Scraper | USGS Mineral Commodity Summaries Scraper |
|---|---|---|---|
| Search by free-text query | Yes | Not listed | Not listed |
| Filter by parent item ID | Yes | Not listed | Not listed |
| Filter by browse category | Yes | Not listed | Not listed |
| Set maximum records | Yes, up to 1,000,000 | Not listed | Not listed |
| Export to CSV, JSON, Excel, XML | Yes | Yes | Not listed |
| Returns title and URL | Yes | Yes | Not listed |
Configure the run
Drive the Actor from a search query, a parent item ID, or a browse category, alone or together, and set a maximum number of records to return. The Input tab lists every parameter.
A first run with the defaults:
A larger pull:
Pricing
Pay-per-result: $0.001 per result collected. You pay only for the results written to your dataset.
| Results collected | Approximate cost |
|---|---|
| 100 results | $0.10 |
| 1,000 results | $1.00 |
| 10,000 results | $10.00 |
New Apify accounts start with $5 in free credit.
Free users
Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.
Run it
- Create a free Apify account with $5 in credit.
- Open the USGS ScienceBase Catalog Scraper.
- Set your inputs and any filters, then click Start.
- Export the results as CSV, Excel, JSON, or XML from the Dataset tab.
Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.
Use with AI agents (MCP)
Give an AI agent live access to USGS ScienceBase Catalog through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:
Then prompt it in plain language to run the scraper and read back the results.
Troubleshooting
Why am I getting no results?
Check that your search query is not too restrictive. Try removing the parent item ID or browse category, or use a broader query. Also verify that the parent item ID is correct.
Why did the run stop at 10 records?
Free users are limited to a 10-record preview. Upgrade to a paid plan to increase maxItems up to 1,000,000.
Why are some records missing fields?
The catalog search may not return every metadata field for every record. Use the record's URL to open the full ScienceBase item for complete metadata.
Can I get the full metadata for a record?
This Actor returns the fields from the catalog search result. For full metadata, fetch the record's URL directly from ScienceBase.
Why did the run time out?
If you set a very high maxItems, the run may take longer. Try reducing maxItems or increasing the Actor's timeout in the run settings.
FAQ
| Question | Answer |
|---|---|
| Do I need a USGS API key? | No. This Actor uses the public ScienceBase catalog search, so no registration or key is required. |
| What is a parent item ID? | It is the ScienceBase identifier for a container item, such as a project or collection. Providing it returns only records that are children of that item. |
| Can I combine search query and browse category? | Yes. All input fields are optional and can be used together. The Actor applies them as filters to the catalog search. |
| What is the maximum number of records? | Free users can preview up to 10 records. Paid users can set maxItems up to 1,000,000. |
| What output formats are supported? | The Actor returns structured data that can be exported to CSV, JSON, Excel, or XML from the Apify platform. |
| Does it return full metadata for each record? | It returns the fields available from the catalog search result, including title, URL, and other standard metadata. For full metadata, use the record's URL to fetch the complete ScienceBase item. |
| Can I search by geographic location? | The input schema does not include a geographic filter. You can use a search query with place names or use a parent item ID that represents a geographic area. |
| Is this an official USGS tool? | No, this is a third-party scraper built on the public ScienceBase catalog search. It is not affiliated with or endorsed by the U.S. Geological Survey. |
| How often is the data updated? | The Actor reads the live catalog at run time, so results reflect the current state of ScienceBase. |
| Can I schedule this Actor to run regularly? | Yes, you can set up a schedule in Apify to run it daily, weekly, or at any interval. |
Related actors
Browse the full ParseForge collection for more scrapers.
🆘 Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.
⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by U.S. Geological Survey. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.
