Pricing

from $0.40 / 1,000 hacker_news_outputs

Hacker News (HN) Stories, Show HN & Jobs Scraper

Fast, structured extraction of Hacker News stories, Show HN launches, Ask HN discussions, scores, and comment counts via official Firebase API.

Pricing

from $0.40 / 1,000 hacker_news_outputs

Rating

0.0

(0)

Developer

Morgane Flamant

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

📰 Hacker News (HN) Stories, Show HN & Jobs Scraper

A high-performance Apify Actor built in Python to extract top stories, Show HN startup launches, Ask HN discussions, and job postings directly from the official Hacker News Firebase REST API.

🌟 Key Features

⚡ Direct Firebase REST API: Hits official Hacker News API endpoints (hacker-news.firebaseio.com/v0) directly via httpx async requests. No headless browser overhead (~128MB RAM footprint).
🎯 Multi-Category Support: Scrape Top Stories, Best Stories, Newest, Show HN (Launches), Ask HN (Discussions), or Job Board.
🔥 Minimum Score Filtering: Filter stories by minimum upvote score to extract high-impact tech discussions.
🚀 Concurrent Async Fetching: Retrieves items concurrently using asyncio.gather for high execution speed.
📊 Store-Ready Dataset: Pushes standardized Pydantic models to Apify's Dataset storage with tabular view support.

📥 Input Parameters

The Actor accepts the following input settings in JSON format:

Parameter	Type	Default	Description
`category`	`string`	`"top"`	Select HN feed category: `top`, `best`, `new`, `show`, `ask`, or `jobs`.
`minScore`	`integer`	`0`	Minimum upvotes (points) required to include a story.
`maxItems`	`integer`	`100`	Maximum number of items to retrieve.

Example Input JSON

{
  "category": "show",
  "minScore": 20,
  "maxItems": 50
}

📤 Output Format

Each item pushed to the output dataset follows a structured schema:

{
  "id": 39821045,
  "title": "Show HN: Fast AI Agent Framework in Rust",
  "item_type": "story",
  "url": "https://github.com/example/fast-agent",
  "hn_url": "https://news.ycombinator.com/item?id=39821045",
  "author": "techbuilder",
  "score": 145,
  "comments_count": 42,
  "created_at": "2026-08-25T08:15:00+00:00",
  "text_content": null
}

🚀 Running Locally

Step 1: Install Dependencies

$pip install -r requirements.txt

Step 2: Run the Actor

$python -m src.main

🐳 Docker Support

To build and run containerized:

docker build -t hn-scraper .
docker run -it hn-scraper

Hacker News Scraper Pro — Stories, Jobs, Show HN, Ask HN

diverse_venture/hackernews-scraper

Comprehensive Hacker News scraper. Get top/new/best stories, Ask HN, Show HN, Who's Hiring jobs, comments, and search results. Uses the official HN Firebase API + Algolia search — no auth required. Export JSON, CSV, or Excel.

Chak Man Fung

Hacker News Scraper - Stories, Jobs, Ask HN & Show HN

lentic_clockss/hacker-news-scraper

Export fresh Hacker News stories, comments, jobs, Ask HN, Show HN, and polls into structured datasets for research, hiring signals, and monitoring.

kane liu

Hacker News Search Scraper Stories, Comments, Show HN, Ask HN

seemuapps/hn-search-scraper

Search Hacker News stories, comments, Show HN, Ask HN, polls, and jobs by keyword, author, date range, points, and comment count. Full text and engagement metrics. No login.

Andrew

Show HN Scraper - Hacker News Stories, Ask & Show HN

flash_scraper/hn-scraper

Show HN scraper for Hacker News - Show HN launches, Ask HN threads, front-page stories and comments with points, authors and timestamps. Filter by minimum points or comments. No API key, no login. Export CSV, JSON or Excel.

Flash Scrape

Hacker News Scraper — Stories, Comments, Ask HN, Show HN

foxlabs/hackernews-intelligence

Scrape Hacker News stories and full comment threads via the official Firebase API. Top stories, Ask HN, Show HN, jobs, new. Built for founder/VC sentiment monitoring, topic clustering, trend tracking. Clean JSON, comment tree depth-controlled.

Berkan Kaplan

Hacker News Scraper - Stories, Points, Comments & Ask HN

feedforge/hacker-news-scraper

Scrape Hacker News stories, Show HN, Ask HN and jobs. Titles, points, authors, comment counts and URLs as JSON or CSV.

Dominik

Hacker News Scraper

centspy/hackernews-scraper

Search and scrape Hacker News stories, comments, Show HN and Ask HN via the public API. No proxy, no browser.

brandon nadeau

Hacker News Scraper — Stories, Comments & Users

junipr/hacker-news-scraper

Scrape Hacker News stories, comments, user profiles, Ask HN, Show HN, jobs, and threaded discussions from the public Firebase API.

junipr

Hacker News Scraper

nogards95/hacker-news-scraper

Scrape Hacker News stories, comments, jobs, Ask HN, and Show HN using Algolia Search API and HN Firebase API. Supports full-text search, date/points filters, and live feeds.

Nogards

5.0

Hacker News Scraper

plantane/hackernews-scraper

Scrape stories, comments, and scores from Hacker News. Supports top, new, best, Ask HN, Show HN, and job feeds. Uses the official Firebase API for reliable, fast data extraction.