Hacker News Scraper – Stories, Comments & Jobs avatar

Hacker News Scraper – Stories, Comments & Jobs

Pricing

Pay per event

Go to Apify Store
Hacker News Scraper – Stories, Comments & Jobs

Hacker News Scraper – Stories, Comments & Jobs

Hacker News scraper for stories, comments, front page, Ask HN, Show HN and 'Who is hiring?' job posts. Search by keyword via the official HN Algolia API. Export to CSV, JSON or Excel. Incremental mode.

Pricing

Pay per event

Rating

0.0

(0)

Developer

Andrew Moffat

Andrew Moffat

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

6 hours ago

Last modified

Features

Limited permissions

Share

Hacker News scraper for stories, comments, front page, Ask HN, Show HN and 'Who is hiring?' job posts. Search by keyword via the official HN Algolia API. Export to CSV, JSON or Excel. Incremental mode.

Hacker News Scraper by Moxie: fast, reliable and polite, built on official/public data sources.

What can it do?

  • Tech recruiting: export and filter 'Who is hiring?' posts
  • Brand and launch monitoring on HN
  • Building datasets of discussions for LLM fine-tuning or RAG
  • Trend research on technologies

Data source

The official Hacker News Algolia search API (hn.algolia.com). Public data only.

Features

  • Pay only for results (pay-per-event pricing, no monthly rental)
  • Incremental mode: scheduled runs return only items you haven't received before
  • LLM-ready output: optional compact Markdown per item for RAG / AI agents
  • Polite rate limiting with automatic retries and backoff
  • Clean, flat JSON you can export as CSV, Excel, JSON or via API

Input example

{
"mode": "search",
"queries": [
"apify"
],
"maxItems": 20
}

Output example

{
"id": "4058874",
"kind": "story",
"url": "https://news.ycombinator.com/item?id=4058874",
"title": "HackerNews API: What if HN does not have API? Make API on the fly with APIfy",
"text": null,
"link": "http://apify.heroku.com/resources/4fca535156983f0001000002",
"author": "example_user",
"points": 132,
"numComments": 49,
"createdAt": "2012-06-02T19:16:33Z",
"storyId": 4058874,
"storyTitle": null,
"query": "apify"
}

Pricing

EventFree planBronzeSilverGold
Story or comment (result)$0.0003$0.00027$0.00024$0.00021
Actor start$0.003 per run$0.003$0.003$0.003

Paid Apify plans get automatic discounts (Bronze -10%, Silver -20%, Gold -30%) on results.

Example: 1,000 results ≈ $0.30 + $0.003 start fee. Apify platform usage is included in the price.

Benchmark: epctex/hackernews-scraper charges $0.0003/result (Apify Store, 30 Oct 2026).

Use via API or MCP

curl -X POST "https://api.apify.com/v2/acts/devteamdrew~hacker-news-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
-H 'Content-Type: application/json' -d '{"mode": "search", "queries": ["apify"], "maxItems": 20}'

AI agents (Claude, Cursor, etc.) can call this actor through the Apify MCP server: add https://mcp.apify.com/?actors=devteamdrew/hacker-news-scraper as an MCP server.

FAQ

Is this allowed?
Yes, it uses HN's official public API.

How do I get all hiring posts?
Set mode to 'Who is hiring?' and leave queries empty.

Can I schedule it?
Yes. Use Apify Schedules together with incremental mode to receive only new items.

Something broke?
Open an issue on the actor's Issues tab; we monitor nightly and usually fix within 24 hours.

Ready-made examples

Open one of these pre-filled tasks and click Try for free:

This actor only collects publicly available data from official or open APIs and respects their rate limits and terms of use.


See real sample rows, FAQs and ready-made feeds at rowsift.co.uk.