Fast News Scraper avatar
Fast News Scraper

Pricing

$29.00/month + usage

Go to Store
Fast News Scraper

Fast News Scraper

Developed by

Tim Green

Tim Green

Maintained by Community

Extract full article text and metadata from popular news sites like The New York Times, AP News, Reuters, CNBC, NPR, and Wired. Scrape thousands of articles in just a few minutes.

5.0 (2)

Pricing

$29.00/month + usage

30

Total users

360

Monthly users

39

Runs succeeded

>99%

Issues response

1.3 days

Last modified

15 days ago

Site

siteEnumOptional

The website to scrape. It must be one of the supported options. To request a website that's not supported, create an issue in the Issues tab.

Value options:

"nytimes.com": string"washingtonpost.com": string"cnn.com": string"reuters.com": string"wired.com": string"cnbc.com": string"apnews.com": string"nbcnews.com": string"npr.com": string"people.com": string"indiatimes.com": string"cbc.ca": string

Default value of this property is "cnn.com"

Query

querystringOptional

The search term for the website. Not all websites support this, and some allow an empty value. See the README for more details.

Default value of this property is "tech"

Sort by

sortEnumOptional

Sort by date or relevance. Not all websites support both. See the README for more details.

Value options:

"date": string"relevance": string

Default value of this property is "date"

Max Items

maxItemsintegerOptional

The approximate maximium number of articles to return.

Default value of this property is 500

Dataset Name

datasetNamestringOptional

If set, results will be stored in the name dataset

Request Queue Name

requestQueueNamestringOptional

If set, requests will be stored in the name queue. This is useful for not pulling the same articles multiple times.

Proxy configuration

proxyobjectRequired

Select proxies to be used by your crawler.