Pricing

$20.00/month + usage

Go to Store

News Website Crawler & Article Extractor

Try for free

xtech/news-source-crawler

Developed by

Xtech

Scrape all articles from any news website. Extract full text, metadata, keywords, and summaries. Ideal for content analysis, research, and news aggregation.

0.0 (0)

Pricing

$20.00/month + usage

Monthly users

Runs succeeded

>99%

Response time

13 days

Last modified

15 days ago

News SEO tools Social media

Back to issues Create new issue

Keywords search query input?

Closed

sherlian opened this issue

Hello, are users able to add inputs such as keywords using advanced boolean operators as search query for specific news sites such as Bloomberg, reuters, channelnewsasia.com? I do not need to crawl the entire site, just specific news articles with the keywords and context. Thanks.

Xtech (xtech)

I'll implement this and come back to you once it's finished. Great Idea!

Xtech (xtech)

I've implemented it. Check it out!

Xtech (xtech)

I've implemented it. Check it out!

Add comment

Pricing

Pricing model

Rental

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

2 hours

Price

$20.00

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

41.9k

4.6/5

Web Scraper

apify/web-scraper

Crawls arbitrary websites using the Chrome browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.

Apify

78.8k

4.5/5

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

82.3k

Twitter (X.com) Scraper Unlimited: No Rate-Limits

apidojo/twitter-scraper-lite

Introducing Twitter Scraper Unlimited, the most comprehensive Twitter data extraction solution available. Our enterprise-grade scraper offers unmatched capabilities with a transparent event-based pricing model, making it perfect for both small-scale and large-scale data extraction needs.

API Dojo

2.7k

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

19.8k

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

23.7k

YouTube Scraper

streamers/youtube-scraper

YouTube crawler and video scraper. Alternative YouTube API with no limits or quotas. Extract and download channel name, likes, number of views, and number of subscribers.

Streamers

15.7k

Youtube Video Downloader

epctex/youtube-video-downloader

Effortlessly download YouTube videos of your preferred quality with our user-friendly Video Downloader. Try it now!

epctex

921

Facebook Comments Scraper

apify/facebook-comments-scraper

Extract data from hundreds of Facebook comments from one or multiple Facebook posts. Get comment text, timestamp, likes count and basic commenter info. Download the data in JSON, CSV, Excel and use it in apps, spreadsheets, and reports.

Apify

Instagram Comments Scraper

apify/instagram-comment-scraper

Scrape Instagram comments from posts or reels. Just add one or more Instagram post URLs to get comment text, post IDs, position, timestamp, owner ids, usernames, profile pics, and URLs. Export scraped datasets, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

11.9k