Hacker News Scraper — Stories, Comments & Trends
Pricing
$2.00 / 1,000 results
Go to Apify Store
Hacker News Scraper — Stories, Comments & Trends
Scrape Hacker News — front page stories, newest posts, job listings, and comments. Track trending tech topics and discussions.
Hacker News Scraper — Top Stories, Points & Comments
Scrape Hacker News front page stories, newest posts, job listings, and comments. Track trending tech topics, upvote rankings, and discussion threads.
✨ Features
- 📰 Extract stories from HN front page (top, new, show, ask, jobs)
- 📊 Full rankings with points, authors, and comment counts
- 🔗 Story URLs and HN discussion links
- 🔄 Configurable post limits
- 🌐 Apify proxy support for reliable scraping
- ⚡ Built on Crawlee + Playwright for production-grade reliability
🚀 Quick Start
# Via Apify CLIapify call hackernews-scraper# Via APIcurl -X POST "https://api.apify.com/v2/acts/N2FD4arChRWa0BSRB/runs" \-H "Authorization: Bearer *** \-H "Content-Type: application/json" \-d '{"input": {"startUrls": [{"url": "https://news.ycombinator.com"}]}}'
📋 Input Parameters
| Field | Type | Default | Description |
|---|---|---|---|
| startUrls | Array | HN homepage | URLs to scrape (supports different feeds) |
| maxProducts | Integer | 50 | Maximum stories to extract |
| proxyConfiguration | Object | Apify proxy | Proxy configuration |
📊 Output
Structured JSON with per-story data:
| Field | Description |
|---|---|
| url | Story URL on HN |
| title | Post title |
| stories[] | Array of extracted stories |
| stories[].title | Headline |
| stories[].url | External link |
| stories[].rank | Position on page |
| stories[].points | Upvote score |
| stories[].author | Username |
| stories[].comments | Comment count |
💰 Pricing
- Model: Pay per result (PAY_PER_EVENT)
- Price: $0.01 per result
- Free Tier: Apify provides $5 free monthly credit
📚 Use Cases
- Startup & tech trend tracking
- Developer community research
- Content curation & newsletters
- Competitive intelligence
- Academic research on tech discourse
⚠️ Disclaimer
Respect Hacker News' terms of service and rate limits when scraping.