Hacker News Scraper — Stories, Comments & Front Page by Keyword avatar

Hacker News Scraper — Stories, Comments & Front Page by Keyword

Pricing

Pay per event

Go to Apify Store
Hacker News Scraper — Stories, Comments & Front Page by Keyword

Hacker News Scraper — Stories, Comments & Front Page by Keyword

Hacker News Scraper: search Hacker News stories and comments by keyword and date, or pull the Top, New, Best, Ask HN, Show HN and Jobs lists, with points, comment counts, authors, URLs and the top comments of each story. Official public APIs. No API key. Pay per item.

Pricing

Pay per event

Rating

0.0

(0)

Developer

IntelScrape

IntelScrape

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

24 days ago

Last modified

Features

Limited permissions

Share

Hacker News Scraper — Stories, Comments & Front Page by Keyword

🇨🇳 Hacker News 采集器:按关键词和日期搜索 Hacker News 的帖子和评论,或抓取 Top、New、Best、Ask HN、Show HN 和招聘列表,包含得分、评论数、作者、链接以及每个帖子的热门评论。使用官方公开 API,无需密钥,按条付费。

🇸🇬 Pengikis Hacker News: cari cerita dan komen Hacker News mengikut kata kunci dan tarikh, atau ambil senarai Top, New, Best, Ask HN dan Show HN dengan mata, komen dan pengarang. Tiada kunci API.

🤖 NEW: Connect This To Your AI!

Use this actor from Claude, ChatGPT, Cursor or any MCP client through the IntelScrape MCP Server, or call it directly over the Apify API.

⚡ Works with n8n, Make, Zapier, Google Sheets and the Apify API.

price billing API key archive

Keyword search across all Hacker News stories and comments, plus live Top/New/Best/Ask/Show/Jobs lists, with top comments attached.

Honest coverage & billing: Search relevance and coverage follow Algolia HN Search. You pay only for results actually delivered, and a built-in cost guard stops the run at your max-charge limit.

🌍 Built for teams in the US, China and Singapore, and anyone who needs this data in a spreadsheet or pipeline.

⭐ Found it useful? Please leave a review; it helps others find it.

⚖️ Lawful business use only. Collect public data only, and comply with the source site's terms, copyright and data-protection laws (GDPR, CCPA, China PIPL, Singapore PDPA).

Examples below are illustrative; names and values may be fictional or out of date.

What is Hacker News Scraper?

Hacker News is where developers, founders and investors decide what matters in tech. A launch that hits the front page can bring tens of thousands of visitors; a critical thread can shape a brand for years. Hacker News Scraper lets you search every story and comment since 2007 by keyword, brand or domain, or pull the live front-page lists, and returns clean rows with points, comment counts, authors and the top replies, for monitoring, research, lead generation or AI analysis.

What does it do?

  • Keyword & domain search: stories, comments, Ask HN or Show HN, newest first, with a date window and a minimum-points filter
  • Live lists: Top, New, Best, Ask, Show and Jobs with their current rank
  • Rich rows: title, URL, domain, text, author, points, comment count, created time and HN link
  • Top comments (on by default): the leading comments of each story with author, time and reply count
  • Many queries per run with deduplicated, consistent output
  • Official public APIs: Algolia HN Search and the Hacker News Firebase API, so data is accurate and stable

Why choose us over cheaper scrapers?

  • Honest output: limits are documented, missing data is labeled, never invented
  • Clean, consistent schema ready for Excel, Sheets, BI tools or an LLM
  • No account risk: no logins, no cookies, no API keys
  • Pay per result with a built-in cost guard; no subscription, failed items are never charged
  • Fast and light: no residential proxy, so runs finish in seconds and stay cheap
  • Maintained by IntelScrape and fixed fast when the source changes

Who is it for?

  • Brand & launch monitoring: see every time your product, domain or competitor is mentioned
  • Developer marketing: find threads to join and topics that resonate
  • Investors & analysts: track interest in startups, tools and technologies
  • Recruiting: pull Who is Hiring and Jobs posts
  • Researchers: build datasets of tech discussion
  • AI agents: summarise what HN thinks about a topic this week

How to use it

In Apify Console (no code)

  1. Click Try for free / Start. The form is prefilled with a working example.
  2. Change the inputs (see examples below).
  3. Click Start, then export the results as JSON, CSV, Excel, XML or HTML, or open them in Google Sheets.
  4. Optional: Schedule the actor to run hourly, daily or weekly.

Via API

curl -X POST "https://api.apify.com/v2/acts/intelscrape~hacker-news-scraper/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{"mode": "search", "queries": ["openai", "web scraping"], "type": "story", "sinceDays": 30, "maxItems": 50}'

Or use the official Apify JavaScript and Python clients:

from apify_client import ApifyClient
client = ApifyClient("YOUR_APIFY_TOKEN")
run = client.actor("intelscrape/hacker-news-scraper").call(run_input={"mode": "search", "queries": ["openai", "web scraping"], "type": "story", "sinceDays": 30, "maxItems": 50})
for item in client.dataset(run["default_dataset_id"]).iterate_items():
print(item)

With AI agents (MCP)

Add Apify's MCP server (https://mcp.apify.com) or the IntelScrape MCP Server to Claude Desktop, Cursor, ChatGPT or any MCP client, then ask in plain language, e.g. "Run intelscrape/hacker-news-scraper with the default input and summarise the results."

Input examples

Search two keywords, last 30 days (default)

{
"mode": "search",
"queries": ["openai", "web scraping"],
"type": "story",
"sinceDays": 30,
"maxItems": 50
}

Current front page with comments

{
"mode": "list",
"list": "top",
"maxItems": 30,
"includeTopComments": true
}

Every comment mentioning your domain this year

{
"mode": "search",
"queries": ["mycompany.com"],
"type": "comment",
"sinceDays": 365,
"maxItems": 1000
}

Output fields

FieldDescription
id / type / hnUrlHN item id, story/comment/ask_hn/show_hn, link
query / rank / listMatching query, or rank in a live list
title / url / domainStory title and link
textSelf-post or comment text (HTML removed)
author / points / commentCount / createdAtEngagement and timing
parentStoryIdFor comments, the story they belong to
topComments[]id, author, createdAt, text, replies

Sample output

{
"id": 41234567,
"type": "story",
"query": "openai",
"title": "OpenAI announces …",
"url": "https://openai.com/index/…",
"domain": "openai.com",
"author": "pg_fan",
"points": 812,
"commentCount": 433,
"createdAt": "2026-10-14T16:02:11Z",
"hnUrl": "https://news.ycombinator.com/item?id=41234567",
"topComments": [{ "author": "dang", "text": "…", "replies": 12 }]
}

Pricing (pay per event)

EventWhen it is chargedPrice
Actor startonce per run$0.005
Itemper story or comment row$0.0005
Top commentsper story with comments attached (on by default; turn off to skip)$0.0005

Cost examples

RunCost
Default run: 2 queries × 50 stories with commentsabout $0.08–$0.105
Front page (30) with commentsabout $0.035
1,000 comments mentioning a domain$0.505

Platform usage is included in these prices. Set Max charge per run in the run options to cap spend; the actor stops cleanly when the limit is reached and keeps everything collected so far.

Tips for best results

  • Search a bare domain (e.g. "stripe.com") to find every link to it.
  • Use minPoints 100+ to keep only stories that reached the front page.
  • Turn off top comments for the cheapest bulk export.
  • Schedule hourly with sinceDays 1 for a real-time brand alert.

FAQ

Is the data official?

Yes. It comes from Hacker News's official Firebase API and the Algolia HN Search API that powers search on the site.

To the start of Hacker News in 2007.

Why are some story URLs empty?

Ask HN and text posts have no external link; their text is in the text field.

Do deleted items show up?

No, deleted and dead items are not returned by the APIs.

Do I need an API key?

No.

Can I get the full comment tree?

This actor attaches top-level comments (up to 20 per story). For full trees, run it in comment mode on the story's keywords or open the hnUrl.

Honest limits

  • Search relevance and coverage follow Algolia HN Search.
  • Points and comment counts are a snapshot at run time.
  • Only top-level comments are attached per story.
  • Very broad queries are capped by maxItems.

This actor collects publicly available data only. You are responsible for using the results lawfully and in line with the source's terms and applicable privacy laws (GDPR, CCPA, PIPL, PDPA). Process personal data only with a legitimate purpose. IntelScrape is not affiliated with, endorsed by or sponsored by the data source; all trademarks belong to their owners.