Pricing

Pay per usage

Hacker News Story & Comment Scraper

Scrape Hacker News top/new/best stories with points, comments, author info, and timestamps. Monitor tech trends, startup news, and developer discussions. Uses official Firebase API for reliable data.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

陈俊杰

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Hacker News Scraper — Apify Actor

Extract stories from Hacker News with filtering by points and keywords.

Features

Fetch top, new, or best stories
Filter by minimum points score
Filter by keywords in story titles (comma-separated)
Structured output: title, URL, points, author, comment count, timestamp
Uses official Firebase API — no scraping, no blocks

Input

Field	Type	Default	Description
`storyType`	enum	`top`	Story feed: top / new / best
`limit`	int	30	Max stories to fetch (≤100)
`minPoints`	int	0	Minimum upvotes filter
`keywords`	string	—	Comma-separated keywords (e.g. `AI,Python,YC`)

Output (one row per story)

{
  "id": 43254321,
  "title": "Show HN: Example Project",
  "url": "https://example.com",
  "author": "username",
  "points": 342,
  "comment_count": 87,
  "hn_url": "https://news.ycombinator.com/item?id=43254321",
  "type": "story",
  "time": 1748217600
}

Use Cases

📰 Tech trend monitoring — what's trending on HN right now
🏢 Startup intelligence — track Show HN launches
🤖 AI training data — collect curated tech news content
📊 Competitive analysis — monitor developer sentiment

Example

# CLI via Apify API
curl -X POST "https://api.apify.com/v2/acts/wsgcjj~hacker-news-scraper/runs" \
  -H "Content-Type: application/json" \
  -d '{"storyType":"top","limit":10,"minPoints":100,"keywords":"AI,LLM"}'

Limits

100 stories max per run (Firebase API limit)
Free API — no API key or proxy needed

Hacker News Stories & Comments Scraper

taroyamada/hacker-news-intelligence

Extract trending tech discussions, nested comment hierarchies, and post scores from Hacker News directly into structured JSON for custom RAG pipelines.

太郎山田

📰 AP News Scraper — Breaking News & Articles

nexgendata/ap-news-scraper

Extract breaking news from Associated Press — headlines, full text, authors, timestamps & categories. Build news monitoring, media analysis & content aggregators. Pay per article.

Stephan Corbeil

🎬 IMDB Scraper — Movies, Ratings & Box Office

nexgendata/imdb-scraper

Extract movies & TV shows from IMDb — ratings, cast, crew, box office, plot summaries. TMDB, OMDb & JustWatch alternative for streaming apps, recommendation engines and entertainment data pipelines. Pay per title — no API key needed.

Stephan Corbeil

📚 Wikipedia Scraper — Articles & Knowledge Data

nexgendata/wikipedia-scraper

Extract structured data from Wikipedia — article text, infoboxes, categories, references & links. Build knowledge bases, AI training datasets & research tools. Pay per article.

Stephan Corbeil

📰 News MCP — AI News Monitoring & Alerts

nexgendata/news-mcp-server

📰 News, headlines, breaking news, news monitoring MCP server for AI agents (Claude Desktop, Cursor, OpenAI Agents SDK, Vercel AI SDK). Real-time news search + topic alerts + multi-source aggregation across Reuters, AP, BBC, Bloomberg via MCP. Free tier available.

Stephan Corbeil

Hacker News Scraper — Stories, Comments & Jobs

cryptosignals/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles — extract title, URL, score, author, comment threads, and submission time. CSV/JSON output.

Web Data Labs

Hacker News Scraper - Stories, Comments & AI Digest

harvestlab/hacker-news-scraper

Scrape HN top stories, search, Ask HN, Show HN, job posts and user profiles via Algolia & Firebase APIs. Zero anti-bot, no API key. AI topic digest (themes, trends, TLDR) via 5 LLM providers. x402-ready. $0.001/item.

Nick

Hacker News Scraper - Stories, Comments & Search

wetyr_corporation/hacker-news-scraper

Bulk extract Hacker News stories, comments, jobs, and Show HN. Search by keyword, filter by points and date. Powered by free Algolia HN API for unlimited reliability.

WETYR

Hacker News Scraper — Stories, Comments & Users

openclawmara/hacker-news-scraper

Scrape Hacker News stories, comments, and user profiles. Extract trending tech news, top stories by score, new submissions, Ask HN, Show HN, and job posts. Filter by date, score, and comment count. Perfect for tech trend analysis, competitive intelligence, and content curation.

OpenClaw Mara

Hacker News Scraper: Stories, Comments, Users & Search

perconey/hackernews-scraper

Scrape Hacker News via the official Firebase API + Algolia search. Top/new/best/ask/show/jobs stories, full comment trees, user profiles with karma, free-text search. No browser, no proxies, no auth. Pay only per result item.