FreightWaves News Scraper
Pricing
from $5.00 / 1,000 article returneds
Scrape public FreightWaves news listings and article pages for headlines, excerpts, authors, dates, sections, tags, images, and visible article text. Use for freight market intelligence and news monitoring. Not for SONAR or subscriber-only data. $0.005/article plus $0.00005 start.
Use this when you want articles from a FreightWaves news, category, tag, pagination, or article URL. Pass full URLs such as https://www.freightwaves.com/news/category/news. Defaults to the public News listing and does not accept SONAR or subscriber-only URLs.
[ { "url": "https://www.freightwaves.com/news/category/news" }]Use this to cap the number of article records returned and billed. Accepts 1 to 100 articles; the default is 20. This is a total across all input URLs, not a per-page limit and not a request count.
Use this to follow pagination from a FreightWaves listing before stopping. Accepts 1 to 10 pages and defaults to 3. This controls listing pages only, not article detail pages or the maximum article count.
Use this when you need the visible article text for monitoring or downstream analysis. Defaults to true; set false for a smaller, metadata-only dataset. This does not bypass paywalls or return subscriber-only text.