DOE OSTI Scientific & Technical Reports Scraper

Extract structured metadata for U.S. Department of Energy (DOE) Office of Scientific and Technical Information (OSTI) reports — the authoritative repository of DOE-funded research output covering fusion energy, nuclear science, renewable energy, climate, materials science, high-energy physics, biology, and more.

OSTI hosts over 3 million scientific records, including technical reports, journal articles, conference papers, theses, and patents produced by DOE national laboratories and grantees. This Actor turns that catalog into clean JSON ready for competitive intelligence, prior-art search, RAG pipelines, and research-trend analysis.

Key Features

• Full-text search — Free-text query across titles, abstracts, and authors
• Subject filtering — Narrow to specific DOE subject categories (fusion, solar, fission, etc.)
• Research org filter — Pull records from a specific national lab (Oak Ridge, Argonne, NREL, LBNL, etc.)
• Product-type filter — Technical Reports, Journal Articles, Theses, Conference Papers, Patents
• Year range filtering — Filter publications by date range
• No authentication required — Public OSTI API, no keys needed
• Rich metadata — Authors, sponsor orgs, research orgs, DOE contract numbers, DOIs, subjects
• Direct OSTI URL — Link to the full record on osti.gov for each result

Output Data Fields

Field	Description
ostiId	OSTI record identifier
title	Report title
doi	Digital Object Identifier
publicationDate	Publication date
productType	Report type (Technical Report, Journal Article, etc.)
country	Country of publication
language	Language
authors	List of author names
sponsorOrgs	DOE sponsoring organizations
researchOrgs	Research organizations (national labs, universities)
subjects	DOE subject categories
doeContractNumber	DOE contract / grant number
description	Abstract text
fullTextUrl	Link to the full text PDF (when available)
ostiUrl	Direct link to the OSTI record page

How to Scrape OSTI Scientific Reports

1. Open the DOE OSTI Reports Scraper on Apify Store
2. (Optional) Enter a search query (e.g., "small modular reactor")
3. (Optional) Filter by subject, research organization, product type, or year range
4. Set max results
5. Click Start — clean JSON is written to the default dataset

Pricing

This Actor uses pay-per-result pricing. The OSTI API is fast and bandwidth-light, so compute costs per run are small. Typical 1,000-record run finishes in well under a minute.

Use Cases

• Competitive intelligence — Track which national labs publish in your domain
• Prior-art search — Find DOE-funded prior art for patent prosecution
• Grant analysis — See which DOE contracts produce specific research outputs
• RAG pipelines — Build domain-specific knowledge bases on energy / physics / materials
• Researcher discovery — Identify domain experts and collaborators at national labs

Legal & Disclaimer

This Actor only accesses publicly available metadata via the official OSTI public API. It does not bypass authentication or access controls. OSTI content is U.S. Government work and generally in the public domain in the United States. Users are responsible for compliance with OSTI terms of service and any third-party rights in linked full-text documents. This tool is provided "as is" without warranty of any kind.