Hacker News Scraper – Stories, Comments & Jobs
Pricing
Pay per event
Hacker News Scraper – Stories, Comments & Jobs
Hacker News scraper for stories, comments, front page, Ask HN, Show HN and 'Who is hiring?' job posts. Search by keyword via the official HN Algolia API. Export to CSV, JSON or Excel. Incremental mode.
Pricing
Pay per event
Rating
0.0
(0)
Developer
Andrew Moffat
Maintained by CommunityActor stats
0
Bookmarked
2
Total users
1
Monthly active users
6 hours ago
Last modified
Categories
Features
Share
Hacker News scraper for stories, comments, front page, Ask HN, Show HN and 'Who is hiring?' job posts. Search by keyword via the official HN Algolia API. Export to CSV, JSON or Excel. Incremental mode.
Hacker News Scraper by Moxie: fast, reliable and polite, built on official/public data sources.
What can it do?
- Tech recruiting: export and filter 'Who is hiring?' posts
- Brand and launch monitoring on HN
- Building datasets of discussions for LLM fine-tuning or RAG
- Trend research on technologies
Data source
The official Hacker News Algolia search API (hn.algolia.com). Public data only.
Features
- Pay only for results (pay-per-event pricing, no monthly rental)
- Incremental mode: scheduled runs return only items you haven't received before
- LLM-ready output: optional compact Markdown per item for RAG / AI agents
- Polite rate limiting with automatic retries and backoff
- Clean, flat JSON you can export as CSV, Excel, JSON or via API
Input example
{"mode": "search","queries": ["apify"],"maxItems": 20}
Output example
{"id": "4058874","kind": "story","url": "https://news.ycombinator.com/item?id=4058874","title": "HackerNews API: What if HN does not have API? Make API on the fly with APIfy","text": null,"link": "http://apify.heroku.com/resources/4fca535156983f0001000002","author": "example_user","points": 132,"numComments": 49,"createdAt": "2012-06-02T19:16:33Z","storyId": 4058874,"storyTitle": null,"query": "apify"}
Pricing
| Event | Free plan | Bronze | Silver | Gold |
|---|---|---|---|---|
Story or comment (result) | $0.0003 | $0.00027 | $0.00024 | $0.00021 |
| Actor start | $0.003 per run | $0.003 | $0.003 | $0.003 |
Paid Apify plans get automatic discounts (Bronze -10%, Silver -20%, Gold -30%) on results.
Example: 1,000 results ≈ $0.30 + $0.003 start fee. Apify platform usage is included in the price.
Benchmark: epctex/hackernews-scraper charges $0.0003/result (Apify Store, 30 Oct 2026).
Use via API or MCP
curl -X POST "https://api.apify.com/v2/acts/devteamdrew~hacker-news-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \-H 'Content-Type: application/json' -d '{"mode": "search", "queries": ["apify"], "maxItems": 20}'
AI agents (Claude, Cursor, etc.) can call this actor through the Apify MCP server: add https://mcp.apify.com/?actors=devteamdrew/hacker-news-scraper as an MCP server.
FAQ
Is this allowed?
Yes, it uses HN's official public API.
How do I get all hiring posts?
Set mode to 'Who is hiring?' and leave queries empty.
Can I schedule it?
Yes. Use Apify Schedules together with incremental mode to receive only new items.
Something broke?
Open an issue on the actor's Issues tab; we monitor nightly and usually fix within 24 hours.
Ready-made examples
Open one of these pre-filled tasks and click Try for free:
Related actors
- Bluesky Scraper – Posts, Profiles & Search
- UK Companies House Scraper – Companies & Directors
- UK Planning Applications Scraper – 400+ Councils & Postcodes
- npm Package Scraper – Downloads & Dependencies
- GitHub Trending Scraper – Repos, Stars & Developers
- Mastodon Scraper – Fediverse Hashtags, Accounts & Trends
- Lemmy Scraper – Posts, Comments & Communities (Fediverse)
- SEC EDGAR Scraper – 10-K, 8-K & Form D Funding Filings
- arXiv Scraper – Paper Search, Abstracts & Authors
- UK Government Tenders Scraper – Contracts Finder, Find a Tender
- UK CQC Care Homes & Providers Scraper – Ratings & Care Leads
- SAM.gov Scraper – Federal Contract Opportunities, No API Key
- UK Operator Licence Scraper – HGV & Bus Operators (DVSA VOL)
- USAspending Federal Awards Scraper – Contracts & Grants
- EU Tenders Scraper – TED Public Procurement Notices
Legal and GDPR
This actor only collects publicly available data from official or open APIs and respects their rate limits and terms of use.
See real sample rows, FAQs and ready-made feeds at rowsift.co.uk.