FreightWaves News Scraper avatar

FreightWaves News Scraper

Pricing

from $23.99 / 1,000 result items

Go to Apify Store
FreightWaves News Scraper

FreightWaves News Scraper

Scrapes public FreightWaves news articles by keyword, category, or date range. Returns each article as a flat row with headline, author, date, and full body text.

Pricing

from $23.99 / 1,000 result items

Rating

5.0

(1)

Developer

ParseForge

ParseForge

Maintained by Community

Actor stats

3

Bookmarked

10

Total users

0

Monthly active users

14 days ago

Last modified

Share

ParseForge

FreightWaves News Scraper

Scrape FreightWaves news articles by keyword, category, or date range, up to a million per run. Each article returns its headline, author, publication date, and full body text. No login or API key. Export to CSV, JSON, Excel, or XML.

FreightWaves is the leading news source for freight markets, but manually tracking trucking rates, maritime disruptions, or supply chain regulation is slow. This Actor reads the public news feeds directly, filtered by logistics category, search keyword, or date, and returns each matching article in one fixed schema.

Who uses itWhat they scrape FreightWaves for
Logistics analystsMonitor daily trucking rate headlines and capacity shifts.
Supply chain managersTrack container shipping disruptions and port congestion news.
Freight brokersFollow LTL and truckload market trends to adjust pricing.
Market researchersCollect historical freight economics articles for quarterly reports.

What it does

This Actor collects FreightWaves news articles by keyword, category, or date range, and returns each one as a flat row.

  • πŸ” Keyword search: find articles mentioning specific freight topics like 'trucking rates' or 'container shortage'.
  • πŸ“‚ Category filter: restrict results to trucking, maritime, railroad, air cargo, logistics, shipping, regulation, supply chains, economics, finance, or weather.
  • πŸ“… Date range: pull articles published between two dates to build a historical dataset or track a developing story.
  • ⚑ High volume: collect up to 1,000,000 articles in a single run for large-scale freight market intelligence.

Results export to CSV, JSON, Excel, or XML, or straight from the API.

What you can do with FreightWaves data

πŸ“ˆ Monitor trucking rate trends.

A logistics analyst runs the Actor daily with the 'trucking' category and a keyword like 'spot rates' to feed a dashboard that flags pricing shifts.

🚒 Track maritime disruption alerts.

A supply chain manager scrapes the 'maritime' category for 'port congestion' weekly, exporting to CSV for a risk report shared with procurement.

πŸ“Š Build a freight news archive.

A market researcher sets a wide date range and the 'economics' category to collect a year of articles for a freight market outlook study.

βš–οΈ Follow regulatory changes.

A compliance officer filters by the 'regulation' category and a keyword like 'FMCSA' to catch new trucking rules as they are reported.

Why choose this scraper

What you get
Full article textThe complete body of each news piece, not a snippet.
Fixed flat schemaEvery article lands in your dataset with the same predictable columns.
No API key neededReads public FreightWaves pages directly with no registration.
Multi-format exportDownload as CSV, JSON, Excel, or XML for your existing workflow.

How it compares

This Actor focuses on high-volume, filtered FreightWaves news extraction with full article text, while other scrapers on Apify offer similar headline-level collection.

FeatureParseForgeFreightWaves News Scraper - Low-costπŸ’²πŸ”₯πŸ“°πŸš›FreightWaves News Scraper
Full article body textYesNot listedYes
Category filter (trucking, maritime, etc.)YesNot listedNot listed
Keyword search within articlesYesNot listedNot listed
Date range filterYesNot listedNot listed
Up to 1,000,000 articles per runYesNot listedNot listed

Configure the run

Drive the Actor from a search keyword, a freight category, and a date range, alone or together, and filters run as each article is read so only matches reach your dataset. The Input tab lists every parameter.

A first run with the defaults:

{
"maxItems": 10
}

A larger pull:

{
"maxItems": 200
}

Pricing

Pay-per-result: $0.03199 per result collected. You pay only for the results written to your dataset.

Results collectedApproximate cost
100 results$3.20
1,000 results$31.99
10,000 results$319.90

New Apify accounts start with $5 in free credit.

Free users

Free-plan runs return up to 10 results as a preview. Upgrade your Apify plan to collect up to 1,000,000 results per run.

Run it

  1. Create a free Apify account with $5 in credit.
  2. Open the FreightWaves News Scraper.
  3. Set your inputs and any filters, then click Start.
  4. Export the results as CSV, Excel, JSON, or XML from the Dataset tab.

Run it programmatically through the Apify API (run-sync-get-dataset-items) or the ApifyClient for JavaScript and Python.

Use with AI agents (MCP)

Give an AI agent live access to FreightWaves through the Model Context Protocol. Add the Actor to Claude, Cursor, or any MCP client:

$claude mcp add --transport http apify "https://mcp.apify.com?tools=parseforge/freightwaves-scraper"

Then prompt it in plain language to run the scraper and read back the results.

Troubleshooting

Why am I getting no results?

Check that your keyword or category combination returns articles on the live FreightWaves site. Also verify your date range is not too narrow or set in the future.

The Actor is running but collecting fewer articles than my maxItems setting.

This is normal when there are not enough articles matching your filters. Try broadening your date range, removing the keyword, or selecting a less specific category.

Some article body text looks truncated or incomplete.

The Actor captures the full text displayed on the public article page. If FreightWaves truncates an article behind a 'read more' paywall, that portion is not accessible.

I get an error about the date format.

The Date From and Date To fields require the exact format YYYY-MM-DD, for example 2024-06-15. Make sure you include the hyphens and use two digits for month and day.

The run takes a long time with a high maxItems value.

Scraping many articles requires polite delays between requests. Reduce the maxItems count or narrow your filters to speed up the run.

FAQ

QuestionAnswer
Does this scraper need a FreightWaves subscription or login?No. It reads the public news pages that anyone can view in a browser. You do not need a FreightWaves account, and it does not access SONAR or subscriber-only content.
What data fields does each article row include?The exact field list is shown in the sample output on the Actor's page. It typically includes the headline, author, publication date, category, and the full body text of the article.
Can I scrape articles from a specific date range?Yes. Set the Date From and Date To inputs in YYYY-MM-DD format, and the Actor will return only articles published within that window.
How many articles can I collect in one run?You can set the maximum up to 1,000,000 articles. The Actor will stop when it hits that number or when no more matching articles are found.
Can I search for a specific topic across all categories?Yes. Enter a keyword like 'intermodal' or 'fuel surcharge' in the search field, and the Actor will return articles matching that term from any category.
What export formats are supported?You can export your dataset as CSV, JSON, Excel, or XML directly from the Apify platform.
Does this Actor scrape SONAR data or subscriber-only articles?No. It only collects articles from the publicly accessible FreightWaves news sections. Paywalled content and SONAR market data are not included.
Can I combine a category filter with a keyword search?Yes. All input filters work together. For example, you can set the category to 'trucking' and the keyword to 'driver shortage' to narrow results.
Is this an official FreightWaves API?No. This is an independent web scraper that extracts data from the public FreightWaves website. It is not affiliated with or endorsed by FreightWaves, Inc.

Browse the full ParseForge collection for more scrapers.

πŸ†˜ Need help? Email parseforge@protonmail.com with your run ID, your input, and what you expected.

⚠️ Disclaimer. This Actor is unofficial and is not affiliated with, endorsed by, or sponsored by FreightWaves, Inc. It collects only publicly available data. You are responsible for using the collected data in compliance with the source's terms of service and applicable data-protection laws, including GDPR, CCPA, and PIPL. Do not use it to collect personal data unlawfully.