Fast News Scraper
Pay $3.00 for 1,000 articles
Fast News Scraper
Pay $3.00 for 1,000 articles
Extract full article text and metadata from popular news sites like The New York Times, Bloomberg, Reuters, BBC, CNBC, and Wired. Scrape thousands of articles in just a few minutes. Scape a single site or provide a list of article URLs to scrape.
Site
site
EnumOptional
The website to scrape. It must be one of the supported options. To request a website that's not supported, create an issue in the Issues tab.
Value options:
"nytimes.com": string"washingtonpost.com": string"bloomberg.com": string"cnn.com": string"bbc.com": string"reuters.com": string"seekingalpha.com/market-news": string"wired.com": string"cnbc.com": string
Default value of this property is "cnn.com"
Query
query
stringOptional
The search term for the website. Not all websites support this, and some allow an empty value. See the README for more details.
Default value of this property is ""
Sort by
sort
EnumOptional
Sort by date or relevance. Not all websites support both. See the README for more details.
Value options:
"date": string"relevance": string
Default value of this property is "date"
Max Items
maxItems
integerOptional
The approximate maximium number of articles to return.
Default value of this property is 500
Article URLs
articleURLs
arrayOptional
A list of article URLs from which to extract data. If any URLs are provided, site, query, and sort will be ignored and only those URLs will be scraped.
Request Queue Name
requestQueueName
stringOptional
If set, requests will be stored in the name queue. This is useful for not pulling the same articles multiple times.
Begin Date
beginDate
stringOptional
ONLY SUPPORTED FOR SOME WEBSITES. Extract articles on or after this date.