News Website Crawler & Article Extractor
Pricing
$20.00/month + usage
Scrape all articles from any news website. Extract full text, metadata, keywords, and summaries. Ideal for content analysis, research, and news aggregation.
The URL of the news website you want to crawl (e.g., https://www.cnn.com).
The maximum number of articles to scrape. Set to 0 for no limit.
The language of the articles. Choose from supported languages.
Filter articles containing specific keywords. Leave blank to get all articles. Supports boolean operators: AND, OR, NOT with parentheses (e.g., 'climate AND (change OR crisis) NOT politics').
Apply keyword search to article titles.
Apply keyword search to article text content.
Make keyword search case sensitive.
Skip articles that have fewer words than this number. Use 0 for no minimum.
Generate article summaries and keywords using Natural Language Processing (NLP). Note: This increases processing time.
Extract and include image URLs from articles.
Timeout for each article request in seconds.
Number of articles to process simultaneously. Higher values = faster crawling but may trigger rate limits.
Spread out the start of requests within each batch to reduce bursts. Set to 0 to disable.
