Hacker News Scraper - Stories, Items & Users avatar

Hacker News Scraper - Stories, Items & Users

Pricing

from $0.70 / 1,000 items

Go to Apify Store
Hacker News Scraper - Stories, Items & Users

Hacker News Scraper - Stories, Items & Users

Extract Hacker News stories (top/new/best/ask/show/job), specific items, or user profiles via the official Firebase API. Clean JSON, no API key.

Pricing

from $0.70 / 1,000 items

Rating

0.0

(0)

Developer

Yusuf

Yusuf

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

3 days ago

Last modified

Share

Hacker News Scraper — Stories, Items & Users

Extract Hacker News stories, items, and user profiles as clean JSON — via the official public Firebase API. No API key, no blocking.

What you get per story/item

{
"id": 48966190,
"type": "story",
"by": "lebovic",
"title": "Qwen 3.8 Max Preview",
"url": "https://www.qwencloud.com/pricing/token-plan",
"score": 96,
"time": 1784451451,
"descendants": 40,
"kids": [48967360, 48967344, 48966879]
}

Three modes

ModeWhat it does
StoriesTop, New, Best, Ask HN, Show HN, or Jobs list, up to 500 items
ItemsSpecific item IDs (stories, comments, polls, jobs)
UserUser profiles by username (karma, about, submitted item IDs)

Optionally set includeComments: true to attach each story's top-level comments (one level deep, capped by maxCommentsPerItem) — kept shallow on purpose so a single run stays fast and bounded.

Why this scraper

  • Official API — Hacker News' own public Firebase backend, not scraped HTML
  • No API key, no rate-limit walls
  • Reliable — no headless browser to break
  • Fast — concurrent fetching for large lists
  • Structured JSON — ready for dashboards, alerts, or LLM/RAG pipelines

Use cases

  • Tech trend monitoring: track what's trending in tech/startups daily
  • Research & datasets: build corpora of discussions for NLP/LLM work
  • Community analytics: user activity and karma tracking
  • Alerts: watch Show HN / Ask HN for keywords

Input example

{
"mode": "stories",
"listType": "top",
"maxItems": 50,
"includeComments": true,
"maxCommentsPerItem": 10
}

FAQ

Is this legal? Reads Hacker News' publicly available Firebase API — no login, no private data.

Why no full comment trees? Comment trees can be arbitrarily deep and expensive to walk. includeComments fetches one level of top-level replies per story; use items mode with a comment's own ID to walk deeper manually.