Hacker News Enhanced Scraper - Stories, Comments & Search
Pricing
from $0.50 / 1,000 results
Hacker News Enhanced Scraper - Stories, Comments & Search
Scrape Hacker News stories, comments, and search results via official Firebase and Algolia APIs. No proxy needed. Supports top, best, new, Ask HN, Show HN, job stories, full-text search, comment extraction, and advanced filtering by points, date, and domain.
Pricing
from $0.50 / 1,000 results
Rating
0.0
(0)
Developer
Moris Chao
Actor stats
0
Bookmarked
2
Total users
1
Monthly active users
8 days ago
Last modified
Categories
Share
Hacker News Enhanced Scraper
Scrape Hacker News stories, comments, and search results using the official Firebase and Algolia APIs. No proxy needed — fast, reliable, and free.
Features
- Multiple modes: Top, Best, New, Ask HN, Show HN, Job stories
- Full-text search: Keyword search via Algolia API
- Recursive comments: Fetch comment trees with configurable depth (1-5 levels)
- Advanced filters: min points, min comments, date range, domain filter
- Fast: Concurrent batch fetching (20 parallel requests)
- No proxy required: Uses official public APIs
Input
| Field | Type | Default | Description |
|---|---|---|---|
mode | string | top | One of: top, best, new, ask, show, job, search |
searchQuery | string | Keyword for search mode (Algolia) | |
maxItems | integer | 100 | Max stories to return (1-1000) |
minPoints | integer | 0 | Minimum points threshold |
minComments | integer | 0 | Minimum comments threshold |
dateFrom | string | Start date filter (YYYY-MM-DD) | |
dateTo | string | End date filter (YYYY-MM-DD) | |
domainFilter | string[] | [] | Only include stories from these domains |
includeComments | boolean | false | Fetch comments for each story |
commentDepth | integer | 2 | Max comment tree depth (1-5) |
flattenComments | boolean | true | Flat array vs nested tree output |
Output
Each story is output as a JSON object:
{"id": 47301085,"title": "Example Title","url": "https://example.com/article","domain": "example.com","author": "username","points": 300,"commentsCount": 67,"createdAt": "2026-03-06T12:30:18.000Z","type": "story","comments": []}
Comment structure (flat)
{"id": 47301100,"author": "commenter","text": "This is a comment with <i>HTML</i> formatting.","createdAt": "2026-03-06T13:00:00.000Z","depth": 1}
Examples
Get top 50 stories with 100+ points
{"mode": "top","maxItems": 50,"minPoints": 100}
Search for AI stories from GitHub
{"mode": "search","searchQuery": "artificial intelligence","maxItems": 30,"domainFilter": ["github.com"]}
Get Ask HN posts with comments
{"mode": "ask","maxItems": 20,"includeComments": true,"commentDepth": 3,"flattenComments": false}
Data Sources
- Firebase API (
hacker-news.firebaseio.com/v0/) — Official HN API for story lists and item details - Algolia API (
hn.algolia.com/api/v1/) — Full-text search with numeric filters
Both APIs are public and free. No authentication or proxy required.
Local Development
npm installapify run --purge
Deploy to Apify
apify loginapify push