Article Crawler (FoxNews, CNBC, etc.) avatar
Article Crawler (FoxNews, CNBC, etc.)
Deprecated

Pricing

Pay per usage

Go to Apify Store
Article Crawler (FoxNews, CNBC, etc.)

Article Crawler (FoxNews, CNBC, etc.)

Deprecated

Developed by

Vee

Vee

Maintained by Community

Scraping articles from FoxNews and CNBC, (more extensibility in the fur Output Schema

0.0 (0)

Pricing

Pay per usage

0

2

2

Last modified

7 months ago

News Article Scraper

Web scraper for extracting structured article data from news websites (currently supports Fox News and CNBC).

Features

  • Handles different article page types (main, business, weather)
  • Filters undesired URLs/category pages
  • Extracts article content, metadata, and related links
  • Built with Apify Platform and Puppeteer

Input Format

{
"urls": [
{ "url": "https://www.foxnews.com/politics", "site": "foxnews" },
{ "url": "https://www.cnbc.com/technology", "site": "cnbc" }
],
"maxPages": 100,
"skippingCategoryPages": true
}

Output Schema

Extracted data structure:

type RawArticlePage = {
url: string;
page_title: string;
article_title_element?: string;
content_elements?: string[];
author_elements?: string[];
article_published_datetime_element?: string;
article_updated_datetime_element?: string;
tag_elements?: string[];
tags?: string[];
category_element?: string;
article_title?: string;
content?: string[];
authors?: string[];
article_published_datetime?: string;
article_updated_datetime?: string;
category?: string;
other_article_links?: string[];
other_links?: string[];
scrape_status: ScrapeStatus;
scraped_at: DateTime;
};