Commodity & Energy News Scraper — Compliant, No-PII Feed
Pricing
from $0.50 / 1,000 results
Commodity & Energy News Scraper — Compliant, No-PII Feed
Scrape fresh commodity & energy news (oil, gas, gold, silver, uranium) into structured JSON — a robots-compliant, self-healing, no-PII data feed and API for pipelines and AI agents.
Pricing
from $0.50 / 1,000 results
Rating
0.0
(0)
Developer
Connor Teskey
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
0
Monthly active users
2 days ago
Last modified
Categories
Share
Compliant Commodity & Energy News Feed
A clean, always-current stream of commodity & energy headlines — crude, natural gas, gold, silver, and uranium/nuclear — delivered as structured JSON you can drop straight into a model, a dashboard, or a trading workflow.
Who it's for
Energy and metals desks, quant pipelines, and research agents that need a current read on commodity narratives — without babysitting a scraper or second-guessing how the data was collected.
What makes it different
- It respects the rules. Every source is checked against its
robots.txtat request time and skipped if disallowed (fail-closed). Public pages only, zero personal data. Nothing here creates compliance risk for you. - It doesn't break. Headlines are found by shape — link text + URL structure — not brittle CSS selectors, so a site redesign won't silently kill your feed. If a source ever returns nothing, it's flagged, not quietly dropped.
- It stays fresh. Built to run on a schedule; point it at hourly or daily and your dataset is never stale.
Output
| field | meaning |
|---|---|
commodity | oil, gold, silver, uranium, … |
title | the headline |
url | canonical article link |
source | source domain |
fetched_at | run timestamp (UTC) |
Input
sources— list of{ url, commodity }; defaults to a curated, robots-clean set (OilPrice, World Nuclear News, Kitco gold & silver, BullionVault, Sprott).maxItemsPerSource— cap per source (default 25).respectRobots— keeptrue; it's the compliance guarantee.
Public sources, structured output, robots respected. No PII, no violations.
