Pricing

Pay per event

Try for free

Go to Apify Store

Hacker News Scraper – Stories, Comments & Who Is Hiring Jobs

Try for free

Search Hacker News stories and comments, export the front page, or extract every 'Who is hiring?' job post, filtered by keyword. Official HN Algolia API, LLM-ready Markdown, incremental mode.

Pricing

Pay per event

Rating

0.0

(0)

Developer

Andrew Moffat

Actor stats

Bookmarked

Total users

Monthly active users

3 hours ago

Last modified

What can it do?

Tech recruiting: export and filter 'Who is hiring?' posts
Brand and launch monitoring on HN
Building datasets of discussions for LLM fine-tuning or RAG
Trend research on technologies

Data source

The official Hacker News Algolia search API (hn.algolia.com). Public data only.

Features

Pay only for results (pay-per-event pricing, no monthly rental)
Incremental mode: scheduled runs return only items you haven't received before
LLM-ready output: optional compact Markdown per item for RAG / AI agents
Polite rate limiting with automatic retries and backoff
Clean, flat JSON you can export as CSV, Excel, JSON or via API

Input example

{
  "mode": "search",
  "queries": [
    "apify"
  ],
  "maxItems": 20
}

Output example

{
  "id": "4058874",
  "kind": "story",
  "url": "https://news.ycombinator.com/item?id=4058874",
  "title": "HackerNews API: What if HN does not have API? Make API on the fly with APIfy",
  "text": null,
  "link": "http://apify.heroku.com/resources/4fca535156983f0001000002",
  "author": "example_user",
  "points": 132,
  "numComments": 49,
  "createdAt": "2012-06-02T19:16:33Z",
  "storyId": 4058874,
  "storyTitle": null,
  "query": "apify"
}

Pricing

Event	Price
Story or comment (`result`)	$0.0003
Actor start	$0.003 per run

Example: 1,000 results ≈ $0.30 + $0.003 start fee. Apify platform usage is included in the price.

Benchmark: epctex/hackernews-scraper charges $0.0003/result (Apify Store, 30 Oct 2026).

Use via API or MCP

curl -X POST "https://api.apify.com/v2/acts/devteamdrew~hacker-news-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H 'Content-Type: application/json' -d '{"mode": "search", "queries": ["apify"], "maxItems": 20}'

AI agents (Claude, Cursor, etc.) can call this actor through the Apify MCP server: add https://mcp.apify.com/?actors=devteamdrew/hacker-news-scraper as an MCP server.

FAQ

Is this allowed?
Yes, it uses HN's official public API.

How do I get all hiring posts?
Set mode to 'Who is hiring?' and leave queries empty.

Can I schedule it?
Yes. Use Apify Schedules together with incremental mode to receive only new items.

Something broke?
Open an issue on the actor's Issues tab; we monitor nightly and usually fix within 24 hours.

This actor only collects publicly available data from official or open APIs and respects their rate limits and terms of use.

Instagram Scraper

apify/instagram-scraper

Extract Instagram posts, reels, profiles, places, hashtags, carousels, and comments. Get data from Instagram using one or more Instagram URLs or search queries: content, context, metrics, metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

459K

4.7

(604)

TikTok Scraper

clockworks/tiktok-scraper

Extract data from TikTok videos, hashtags, and users. Use URLs or search queries to scrape TikTok profiles, hashtags, posts, URLs, shares, followers, hearts, names, video, and music-related data. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Clockworks

371K

4.7

(370)

Google Maps Scraper

compass/crawler-google-places

Extract data from thousands of Google Maps locations and businesses, including reviews, reviewer details, images, contact info, including full name, email, and job title, opening hours, prices & more. Export data, run via API, schedule and monitor runs, or integrate with other tools.

Compass

674K

4.7

(1,821)

Instagram Profile Scraper

apify/instagram-profile-scraper

Scrape all Instagram profile info. Just add Instagram usernames, IDs or URLs and extract name, join date, number of followers, location, bio, website, related profiles, video&post count, latest posts. Export scraped data, schedule scraper via API, and integrate with other tools or AI workflows.

Apify

269K

4.7

(175)

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract posts, videos, and engagement metrics from Facebook pages. Get text captions, reactions, video transcripts, images, external links, collaborators, and more from Facebook pages and profiles. Export ad data, schedule runs via API, and integrate with other tools or AI workflows.

Apify

134K

4.7

(236)

Google Search Results Scraper

apify/google-search-scraper

Scrape Google Search Engine Results Pages (SERPs). Select the country or language and extract organic and paid results, AI Mode, AI overviews, ads, queries, People Also Ask, prices, reviews, like a Google SERP API. Export data, run the scraper via API, schedule runs, or integrate with other tools.

Apify

223K

4.7

(218)

YouTube Scraper

streamers/youtube-scraper

YouTube crawler and video scraper. Alternative YouTube API with no limits or quotas. Extract and download channel name, likes, number of views, and number of subscribers.

Streamers

192K

4.8

(196)

Tweet Scraper V2 - X Scraper / Twitter Scraper / X.com Scraper

apidojo/tweet-scraper

Lightning-fast search, URL, list, and profile scraping, with customizable filters. At $0.40 per 1000 tweets, and 30-80 tweets per second, it is ideal for researchers, entrepreneurs, and businesses! Get comprehensive insights from Twitter (X) now!

API Dojo

124K

3.9

(196)

Web Fetch

apify/web-fetch

Download any web page by URL and convert it to clean Markdown, plain text, HTML, and other formats. Automatically renders JavaScript and works around bot blocking. The Actor provides a real-time API for quick response times.

Apify

44K

5.0

(4)

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including caption, metrics, images, mentions, coauthors, recent comments, sponsored status, video duration, views. Export scraped data, schedule scraper via API, integrate with other tools or AI workflows.

Apify

151K

4.3

(139)