Pricing

from $0.10 / 1,000 dataset items

Hacker News Scraper

Scrape Hacker News stories and users via the HN Firebase API and Algolia search API. Supports search, top, new, best, and user modes.

Pricing

from $0.10 / 1,000 dataset items

Rating

0.0

(0)

Developer

Moeeze Hassan

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Features

Search mode — keyword search via the Algolia HN search API
Top / New / Best modes — fetch front-page story lists from the Firebase API
User mode — retrieve a user's submitted stories
Point and story-type filtering applied to all Firebase modes

Input Fields

Field	Type	Required	Default	Description
`mode`	string (enum)	✅	`top`	Scraping mode: `search`, `top`, `new`, `best`, or `user`.
`query`	string	❌	`""`	Search query (for `search` mode) or username (for `user` mode).
`numResults`	integer	❌	`30`	Maximum number of results to return (1–500).
`minPoints`	integer	❌	`0`	Only return stories with at least this many points (applied to story modes).
`storiesOnly`	boolean	❌	`true`	If `true`, only return story items (excludes comments, polls, etc.). Applies to Firebase modes.

Output Fields

Each pushed dataset item is a story record with the following fields:

Field	Type	Description
`id`	string	HN item ID.
`title`	string	Story title.
`url`	string	External story URL (empty for text/self posts).
`points`	integer	Story score.
`author`	string	Username of the submitter.
`date`	string	Submission date (ISO-8601).
`commentsCount`	integer	Number of comments.
`hnUrl`	string	Direct link to the HN thread.
`type`	string	Item type (typically `story`).

Usage Example

Fetch the top 50 stories with at least 100 points

{
    "mode": "top",
    "numResults": 50,
    "minPoints": 100,
    "storiesOnly": true
}

Search Hacker News for "rust async"

{
    "mode": "search",
    "query": "rust async",
    "numResults": 30
}

Get stories submitted by a specific user

{
    "mode": "user",
    "query": "pg",
    "numResults": 20
}

Run via the Apify CLI

$apify run hacker-news-scraper --input '{"mode":"top","numResults":50,"minPoints":100}'

Data Sources

Firebase API (hacker-news.firebaseio.com) — used for top, new, best, and user modes.
Algolia Search API (hn.algolia.com) — used for search mode.

Hacker News Stories, Comments & Users Scraper

crawlerbros/hacker-news-scraper

Scrape Hacker News - search stories and comments, fetch top/new/best stories, get user profiles and submission history. Uses the official Algolia HN Search API and Hacker News Firebase API.

Crawler Bros

Hacker News Scraper: Stories, Comments, Users & Search

nominated_tupelo/hacker-news-scraper

Scrape Hacker News stories, comments, user profiles, and search by keyword using the official HN Firebase API and Algolia search API. No auth required.

kade

Hacker News Scraper

lulzasaur/hn-scraper

Scrape Hacker News stories and comments. Get top, new, best, ask, show, and job stories via Firebase API. Full-text search via Algolia HN API. Includes scores, authors, timestamps.

lulz bot

Hacker News Scraper

moving_beacon-owner1/my-actor-76

A production-ready Apify Actor that scrapes Hacker News stories, comments, user profiles, and search results using the official Firebase API and Algolia HN Search API.

Jamshaid Arif

Hacker News Scraper

rupom888/hackernews-scraper

Scrape stories, jobs, comments, and polls from Hacker News using the official HN Firebase API. Get top/new/best/ask/show stories with comments, search by keyword via Algolia HN Search API. Reliable and no rate limiting.

Syed Rupom

Hacker News Scraper

plantane/hackernews-scraper

Scrape stories, comments, and scores from Hacker News. Supports top, new, best, Ask HN, Show HN, and job feeds. Uses the official Firebase API for reliable, fast data extraction.

Daniel

Hacker News Scraper

nogards95/hacker-news-scraper

Scrape Hacker News stories, comments, jobs, Ask HN, and Show HN using Algolia Search API and HN Firebase API. Supports full-text search, date/points filters, and live feeds.

Nogards

5.0

Hacker News Enhanced Scraper - Stories, Comments & Search

hata1234/hn-scraper

Scrape Hacker News stories, comments, and search results via official Firebase and Algolia APIs. No proxy needed. Supports top, best, new, Ask HN, Show HN, job stories, full-text search, comment extraction, and advanced filtering by points, date, and domain.

Moris Chao

Hacker News Scraper

blazing_stake/hackernews-scraper

Search and scrape Hacker News stories, comments and discussions via the official HN Algolia API. Filter by keyword, type, points, date. No API key.

Mehmet Kut

Hacker News Scraper

cloud9_ai/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles via official Firebase API. Get top, new, best, ask, show stories with scores, comments, and author data.