HN Top Stories Scraper avatar

HN Top Stories Scraper

Pricing

from $0.01 / 1,000 results

Go to Apify Store
HN Top Stories Scraper

HN Top Stories Scraper

Scrape Hacker News top stories — extract title, URL, score, author, comment count, and submission time. Monitor HN front page in real time. CSV/JSON.

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

Web Data Labs

Web Data Labs

Maintained by Community

Actor stats

0

Bookmarked

4

Total users

1

Monthly active users

11 hours ago

Last modified

Share

HN Top Stories Scraper — Hacker News Scraper with Comments

The most complete hacker news scraper on Apify. Extract stories AND top comments from Hacker News in one run. Perfect for tech trends analysis, content monitoring, and data pipelines.

Why This Actor?

Unlike basic scrapers, this HN comments scraper fetches the top 3 comments per story — giving you the community reaction, not just headlines. Built on the official HN Firebase API for reliability and speed.

Features

  • Scrape up to 500 stories per run from any HN list
  • Comment extraction — top 3 comments per story (unique feature)
  • Filter by score, comment count, or keyword
  • Five list types: top, new, best, ask, show
  • Uses the official HN stories API (Firebase) — fast and reliable
  • Pay-per-result pricing — only pay for what you get

Use Cases

  • Hackernews data collection for research and analytics
  • Tech trends analysis — track emerging topics and sentiment
  • Feed HN stories API data into your dashboards or Slack
  • Monitor competitor mentions and industry keywords
  • Academic research on developer communities

Input

ParameterTypeDefaultDescription
listTypeenumtopStory list: top, new, best, ask, show
maxItemsnumber30Stories to fetch (max 500)
minScorenumber0Minimum score filter
minCommentsnumber0Minimum comment count filter
keywordstringFilter by keyword in title
includeCommentsbooleantrueFetch top 3 comments per story

Output Example

{
"title": "Show HN: I built an open-source alternative to...",
"url": "https://example.com",
"score": 342,
"by": "author",
"descendants": 127,
"time": "2026-03-10T14:30:00Z",
"hnUrl": "https://news.ycombinator.com/item?id=...",
"topComments": [
{"by": "user1", "text": "This is great because...", "score": 45},
{"by": "user2", "text": "Have you considered...", "score": 32}
]
}

Pricing

This actor uses pay-per-event billing. You are charged per story extracted — no platform fees, no minimums. Check the Pricing tab for current rates.

Integrations

Works with all Apify integrations: webhooks, API, Zapier, Make, Google Sheets, and more. Schedule daily runs to build a hackernews data pipeline automatically.

🔒 Proxy Configuration

While Hacker News is relatively scraper-friendly, high-frequency scraping can trigger IP-based rate limits. For production workloads, residential proxies ensure uninterrupted data collection.

ThorData Residential Proxies provide 200M+ IPs across 195 countries with automatic rotation — ideal for continuous HN monitoring without blocks.