🔬 Energy.gov Scraper

🚀 Collect U.S. Department of Energy articles, press releases, and documents in seconds. Filter by keyword, office, article type, and language. No coding, no API keys required.

Pull structured records from US Energy.gov Data — clean fields ready as CSV, JSON, JSONL, Excel, or XML for downstream pipelines.

Copy to your AI assistant

Copy this block into ChatGPT, Claude, Cursor, or any LLM to start using this actor.

parseforge/energy-gov-scraper on Apify. Call: ApifyClient("TOKEN").actor("parseforge/energy-gov-scraper").call(run_input={...}), then client.dataset(run["defaultDatasetId"]).list_items().items for results. Key inputs: maxItems (integer, default 10), keywords (string), articleType (string), language (string), office (string), sort (string, default "date"). Full actor spec: fetch build via GET https://api.apify.com/v2/acts/parseforge~energy-gov-scraper (Bearer TOKEN). Get token: https://console.apify.com/account/integrations

The Energy.gov Scraper automates the collection of official content from the U.S. Department of Energy website. It pulls articles, press releases, congressional testimonies, blog posts, success stories, and multimedia content directly from the DOE search system. Each record includes the headline, publication date, source office, content category, direct link, and unique identifier. You can filter by keyword, article type, DOE office, and language to zero in on exactly the content you need. Free users can collect up to 10 items per run, while paid users can retrieve up to 1,000,000 results.

Whether you are tracking renewable energy policy shifts, monitoring nuclear research announcements, or building a dataset of DOE press releases for media analysis, this tool replaces hours of manual browsing with a single automated run. Results export to JSON, CSV, or Excel for immediate use in spreadsheets, dashboards, or data pipelines. Schedule recurring runs to stay current with the latest DOE publications without lifting a finger. The scraper handles pagination, deduplication, and rate limiting automatically so you can focus on analysis instead of data collection.

Target Audience	Use Cases
Policy Analysts	Monitor federal energy policy announcements and congressional testimonies
Academic Researchers	Build literature databases from DOE research publications
Energy Industry Professionals	Track regulatory changes and press releases by office
Journalists	Follow DOE news across topics like renewables, nuclear, and fossil fuels
Data Analysts	Export structured DOE content for trend analysis and reporting
Government Affairs Teams	Stay current on DOE initiatives and funding announcements

📋 What the Energy.gov Scraper does

• 📝 Article headlines - capture the title of every article, press release, blog post, or document published on energy.gov
• 🔗 Direct URLs - collect working links to each piece of content for quick reference or archival
• 📅 Publication dates - track when content was published to build timelines and spot trends
• 👤 Source offices - identify which DOE office or organization published the content (e.g., Office of Energy Efficiency and Renewable Energy)
• 🎯 Content categories - classify each item by type: blog, press release, document, success story, congressional testimony, or multimedia
• 🆔 Unique identifiers - get UUIDs for each article to manage deduplication and data integrity

The scraper connects to the DOE search system and iterates through results using your specified filters. It collects structured data from each listing, normalizes timestamps, and removes duplicate entries using unique article IDs. All results are pushed to an Apify dataset in real time, so you can preview data as the run progresses.

💡 Why it matters: Energy.gov publishes thousands of articles annually across dozens of offices. Manually tracking this content is impractical. This scraper gives you structured, filterable access to the entire catalog in minutes.

📊 Data fields

Each record includes: date, offices, scrapedTimestamp, title, type, url, uuid. All 7 field names come from a real production run, so what you see here is what lands in your dataset.

⚠️ Good to Know: Free users are automatically limited to 10 items per run. Leave keywords empty to browse all available content. The articleType field uses numeric codes internally, but you can also use descriptive names.

🚀 How to use

1. Sign up - Create a free Apify account with $5 credit
2. Find the Actor - Search for "Energy.gov Scraper" in the Apify Store
3. Configure your filters - Set keywords, article type, office, language, and max items
4. Start the run - Click "Start" and watch results appear in real time
5. Export your data - Download as JSON, CSV, or Excel from the dataset tab

🕒 Typical run time: 30 seconds to 2 minutes for up to 100 items. Larger runs with 500+ items may take 5 to 10 minutes.

🔗 Recommended Actors

Actor	Description
USAspending Scraper	Extract federal spending data and contract information from USAspending.gov
GSA eLibrary Scraper	Collect government contractor and vendor data from the GSA eLibrary
PR Newswire Scraper	Collect press releases and news articles from PR Newswire
FINRA BrokerCheck Scraper	Search broker and firm registration data from the FINRA registry
FAA Aircraft Registry Scraper	Look up aircraft registration records by N-number from the FAA

💡 Pro Tip: Combine the Energy.gov Scraper with the USAspending Scraper to cross-reference DOE announcements with actual federal spending data.

Disclaimer: This Actor is an independent tool and is not affiliated with, endorsed by, or sponsored by the U.S. Department of Energy or Energy.gov. All trademarks mentioned are the property of their respective owners.

🆘 Need Help?

If you hit a bug, have questions about setup, or need a scraper we haven't built yet, open our contact form or write to parseforge@protonmail.com. We also take on paid custom data projects.

For faster answers, join our Discord. It's the best place to get support and suggest new actors.