Hacker News Scraper - Stories Jobs & Comments
Pricing
Pay per usage
Go to Apify Store

Hacker News Scraper - Stories Jobs & Comments
Scrape Hacker News via Firebase API. Top, new, best, ask, show, job stories. Filter by score. Optional comments.
Pricing
Pay per usage
Rating
0.0
(0)
Developer
oscar lira
Maintained by Community
Actor stats
0
Bookmarked
2
Total users
1
Monthly active users
2 days ago
Last modified
Categories
Share
Hacker News Scraper - Stories, Jobs & Comments
Lightweight Apify actor that scrapes Hacker News using the official Firebase API. Pure HTTP requests, no browser needed.
Features
- Scrape Top, New, Best, Ask HN, Show HN, and Job stories
- Filter by minimum score
- Optionally fetch top-level comments for each story
- Concurrent fetching with rate-limit-friendly batching (10 parallel requests)
- Outputs structured JSON with extracted domains, ISO dates, and HN discussion links
Input
| Field | Type | Default | Description |
|---|---|---|---|
storyType | enum | top | Category: top, new, best, ask, show, job |
maxResults | integer | 50 | Number of stories to return (1-500) |
includeComments | boolean | false | Fetch top-level comments per story |
minScore | integer | — | Only return stories with at least this score |
Output
Each story in the dataset contains:
| Field | Type | Description |
|---|---|---|
id | integer | HN item ID |
title | string | Story title |
url | string | External link (null for text-only posts) |
score | integer | Upvote count |
author | string | Submitter username |
time | integer | Unix timestamp |
timeISO | string | ISO 8601 date |
commentCount | integer | Total comments |
type | string | story, job, or poll |
text | string | Body HTML (Ask HN, Show HN, jobs) |
domain | string | Extracted from URL |
hnUrl | string | Link to HN discussion |
comments | array | Top-level comments (if enabled) |
Running locally
cd hackernews-scrapernpm installecho '{ "storyType": "top", "maxResults": 10 }' | npx apify-cli run --purge
Technology
- Node.js 20 (Alpine)
- Native
fetch(no axios/got) - Apify SDK v3