Hacker News Scraper - Stories, Items & Users
Pricing
from $0.70 / 1,000 items
Hacker News Scraper - Stories, Items & Users
Extract Hacker News stories (top/new/best/ask/show/job), specific items, or user profiles via the official Firebase API. Clean JSON, no API key.
Pricing
from $0.70 / 1,000 items
Rating
0.0
(0)
Developer
Yusuf
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
3 days ago
Last modified
Categories
Share
Hacker News Scraper — Stories, Items & Users
Extract Hacker News stories, items, and user profiles as clean JSON — via the official public Firebase API. No API key, no blocking.
What you get per story/item
{"id": 48966190,"type": "story","by": "lebovic","title": "Qwen 3.8 Max Preview","url": "https://www.qwencloud.com/pricing/token-plan","score": 96,"time": 1784451451,"descendants": 40,"kids": [48967360, 48967344, 48966879]}
Three modes
| Mode | What it does |
|---|---|
| Stories | Top, New, Best, Ask HN, Show HN, or Jobs list, up to 500 items |
| Items | Specific item IDs (stories, comments, polls, jobs) |
| User | User profiles by username (karma, about, submitted item IDs) |
Optionally set includeComments: true to attach each story's top-level comments (one level deep, capped by maxCommentsPerItem) — kept shallow on purpose so a single run stays fast and bounded.
Why this scraper
- ✅ Official API — Hacker News' own public Firebase backend, not scraped HTML
- ✅ No API key, no rate-limit walls
- ✅ Reliable — no headless browser to break
- ✅ Fast — concurrent fetching for large lists
- ✅ Structured JSON — ready for dashboards, alerts, or LLM/RAG pipelines
Use cases
- Tech trend monitoring: track what's trending in tech/startups daily
- Research & datasets: build corpora of discussions for NLP/LLM work
- Community analytics: user activity and karma tracking
- Alerts: watch Show HN / Ask HN for keywords
Input example
{"mode": "stories","listType": "top","maxItems": 50,"includeComments": true,"maxCommentsPerItem": 10}
FAQ
Is this legal? Reads Hacker News' publicly available Firebase API — no login, no private data.
Why no full comment trees? Comment trees can be arbitrarily deep and expensive to walk. includeComments fetches one level of top-level replies per story; use items mode with a comment's own ID to walk deeper manually.