UK Fuel Prices Scraper
Pricing
from $1.05 / 1,000 results
Today's petrol and diesel prices at ~3,000 UK forecourts, from the retailers' own CMA open-data feeds: station, brand, postcode, coordinates and pence per litre for E10, E5, B7 and super diesel. Stale feeds are excluded by age -- one publishes prices nineteen months old.
Which CMA scheme feeds to read. Leave empty for all ten reachable ones. Asda is part of the scheme but its robots.txt disallows the feed, so it is never fetched; BP, Sainsbury's, Ascona and Karan are unreachable (403 / dead host / broken TLS / timeout). Every run reports those five as feed_not_fetched rows so the coverage gap is visible.
Each feed carries ONE last_updated timestamp. On the day this was built, four of ten were stale - Tesco, Rontec and Shell by ~4 months and Applegreen by 19 months - and their prices (E10 at 138.8p) look perfectly plausible next to today's ~170p. Stations from feeds older than this are excluded and the summary names each excluded feed with its age. Set to 0 to accept only feeds updated today.
Keep stations from stale feeds, each labelled with feedAgeDays and feedIsStale, instead of dropping them.
Keep only stations selling at least one of these. E10 = petrol, E5 = super unleaded, B7 = diesel, SDV = super diesel.
Outward-code letters - SW, M, EH, BS. Keep only stations in these areas.
Shell, Esso, BP, Tesco, Texaco, JET... Matched against the normalised brand - the feeds spell Shell three ways.
Drop stations whose site_id is a placeholder geohash (7zzzzzzzzzzz) or whose coordinates fall outside the UK - Morrisons' feed, for instance, holds a single station located in Gibraltar. They are counted in the summary either way.
Overall cap. The ten reachable feeds hold about 3,000 stations between them.
Feeds fetched in parallel. Each is one request.
