News Website Crawler & Article Extractor
Pricing
$20.00/month + usage
News Website Crawler & Article Extractor
Scrape all articles from any news website. Extract full text, metadata, keywords, and summaries. Ideal for content analysis, research, and news aggregation.
0.0 (0)
Pricing
$20.00/month + usage
3
Total users
58
Monthly users
28
Runs succeeded
>99%
Response time
13 days
Last modified
2 months ago
News Source URL
urlstringRequired
The URL of the news website you want to crawl (e.g., https://www.cnn.com).
Maximum Articles
maxArticlesintegerOptional
The maximum number of articles to scrape. Leave blank for no limit.
Default value of this property is 100
Language
languagestringOptional
The language of the articles as a 2-letter ISO code (e.g., 'en', 'es').
Default value of this property is "en"
Keyword Search [Optional]
keywordSearchstringOptional
Filter articles containing specific keywords. Leave blank to get all articles. For advanced searches, you can use AND, OR, NOT operators (e.g., 'climate AND (change OR crisis) NOT politics').
Extract Summary & Keywords
extractSummarybooleanOptional
Generate article summaries and keywords using NLP.
Default value of this property is true
Include Images
includeImagesbooleanOptional
Whether to include image URLs in the results.
Default value of this property is true
