Hacker News Scraper — Stories, Comments & Trends
Pricing
Pay per event
Hacker News Scraper — Stories, Comments & Trends
Scrape Hacker News via the official Firebase API: top/new/best/ask/show stories with scores, authors and comment threads. No browser, no proxies, no API key.
Pricing
Pay per event
Rating
0.0
(0)
Developer
XiaoZhi DataTools
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
a month ago
Last modified
Categories
Security
Limited permissionsShare
Scrape Hacker News through the official Firebase API + Algolia full-text search over plain HTTP. No browser, no proxies, no API key, no practical rate limits.
Two modes
Feed mode (leave searchQuery empty) — scrape what's hot right now:
pick one of 6 feeds (Top stories, Newest, Best, Ask HN, Show HN, Jobs) and pull the latest stories with their comment threads. Best for trend monitoring and daily digests.
Search mode (fill in searchQuery) — search all of HN history:
full-text search across every story ever posted, e.g. "LLM fine-tuning" returns 565 matching stories ranked by relevance. Best for topic research, sentiment backtracking, and finding every Show HN launch in a category. Comments are still fetched per story via the Firebase API.
What you get
Story rows — title, URL, score, author, comment count, text (for Ask/Show HN), direct HN link, timestamp.
Comment rows — top-level comments per story with clean text, author, timestamp, and HN link.
Key features
- 6 feeds + Algolia full-text search (search overrides feed when set)
- Keyword filter on story titles + minimum score filter
- Comment threads with concurrent fetching — fast even for 30 stories × 10 comments
- Never silently empty: API errors become readable error rows
Input
Pick a feed or type a search query for Algolia full-text search, optionally filter by keyword/score, choose how many stories and comments, run.
Pick your mode
| You need | Fill in | You pay for |
|---|---|---|
| Stories only | Feed / search mode | story $0.001 each |
| Comments too | Tick include comments | comment $0.0005 each |
Unfilled inputs cost nothing — first 20 items per run are free anyway.
Pricing
- $0.001 per story ($1.00 / 1,000 stories)
- $0.0005 per comment ($0.50 / 1,000 comments)
- First 20 items of every run are free (stories + comments combined)
- Actor start: $0.00005
- Setup-guide and error rows are never charged
Typical uses
- Tech trend monitoring (feed mode): what is HN talking about today?
- Topic research (search mode): every HN discussion about a technology, ever
- Startup research: Show HN launches, Ask HN discussions, hiring threads
- Content & sentiment datasets for analysis and ML
