Pricing

from $0.10 / 1,000 results

Tech News Aggregator

Aggregate and scrape tech news articles from multiple sources (Hacker News, TechCrunch, The Verge, Ars Technica, etc.). Get article titles, URLs, points, comments, and full content in one run.

Pricing

from $0.10 / 1,000 results

Rating

0.0

(0)

Developer

Cyril R

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Features

Multi-source aggregation via RSS feeds and APIs
Hacker News via Algolia API (with points, comments, author)
Normalize all articles to a common schema
Filter by date range and minimum points (HN only)
Sort by publication date (newest first)

Input

Field	Type	Default	Description
`sources`	array	`["hackernews","techcrunch","verge","ars-technica"]`	Sources to scrape.
`maxArticlesPerSource`	integer	`30`	Max articles per source.
`minPoints`	integer	`0`	Min points for HN stories.
`dateFrom`	string	`""`	ISO date filter (e.g. `2025-01-01`).

Available Sources

hackernews - Hacker News (Algolia API)
techcrunch - TechCrunch RSS
verge - The Verge RSS
ars-technica - Ars Technica RSS
engadget - Engadget RSS
wired - Wired RSS
the-information - The Information RSS
stratechery - Stratechery RSS

Pricing

Pay-per-event: charged per article returned to the dataset.

Lobste.rs Scraper

resounding_diplomacy/lobste-rs-scraper

Scrapes Lobste.rs tech news aggregator - stories, comments, and metadata. Get titles, URLs, scores, tags, and discussion counts from this niche but active tech community. Perfect complement to Hacker News scraping.

alars num

404 Media Articles Scraper | Tech Investigative News

parseforge/404media-articles-scraper

Collect 404 Media articles with title, author, publication date, full body, and tags. Filter by section, topic, or keyword. Built for tech journalists, AI researchers, and media monitoring teams tracking investigative tech reporting on platforms, AI, and digital culture.

ParseForge

Slashdot Scraper | Tech News and Comments

parseforge/slashdot-scraper

Scrape tech stories from Slashdot including titles, summaries, departments, authors, comment counts, tags and timestamps. Build datasets of technology news and community discussion for trend analysis, content curation and media research at scale across the full catalog

ParseForge

Hacker News Scraper — Stories, Comments & Users

openclawmara/hacker-news-scraper

Scrape Hacker News stories, comments, and user profiles. Extract trending tech news, top stories by score, new submissions, Ask HN, Show HN, and job posts. Filter by date, score, and comment count. Perfect for tech trend analysis, competitive intelligence, and content curation.

OpenClaw Mara

Lobsters Scraper | Tech News and Discussions

parseforge/lobsters-scraper

Scrape tech stories from Lobsters including titles, links, tags, scores, comment counts, submitters and timestamps. Build datasets of developer-focused news and discussions for trend analysis, content curation and technology research projects at scale across the full catalog

ParseForge

Hacker News Scraper

sweet_rebel/hacker-news-scraper

Rajat Sharda

Lobsters Scraper

crawlerbros/lobsters-scraper

Scrape Lobsters (lobste.rs) â€" a curated tech link aggregator. Fetch hottest, newest, or tag-filtered stories with scores, comments, tags, and author info. No authentication required.

Crawler Bros

Techmeme Scraper | Tech News Headlines

parseforge/techmeme-scraper

Scrape tech news from Techmeme including headlines, source links, summaries, related coverage, timestamps and discussion links. Build curated technology news datasets for trend monitoring, media analysis and content aggregation projects at scale across the full catalog

ParseForge

Hacker News Scraper

muscular_quadruplet/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles. Extract top stories, new posts, Show HN, Ask HN. Monitor tech trends, track discussions, build news aggregators. Real-time tech news scraping.

Do It

AI News Aggregator

david_flagg/ai-news-aggregator

Aggregate AI and ML news from Hacker News, Papers With Code, MIT Technology Review, The Batch, and Import AI. Filter by keywords, date range, minimum score. Get titles, URLs, authors, summaries, topic tags, arXiv links, and code repos. Real-time data, sorted by date or relevance.