Pricing

from $3.00 / 1,000 results

Try for free

Go to Apify Store

Hacker News Scraper

Try for free

Scrape Hacker News stories, comments, jobs, and user profiles via the official Firebase API. Modes: top/new/best/ask/show/jobs/past/item/user/search. Filters: minScore, domainFilter, dateRange, commentMinScore. No proxy, no auth.

Pricing

from $3.00 / 1,000 results

Rating

5.0

(11)

Developer

Crawler Gang

Actor stats

Bookmarked

Total users

Monthly active users

9 days ago

Last modified

Categories

Automation

News

Developer tools

Mode

mode

Required

What to scrape. topStories / newStories / bestStories / askStories / showStories / jobStories walk the public feeds. item fetches specific item IDs (itemIds). user fetches profiles (usernames). search uses the Algolia HN API (searchQuery).

Type:string

Default:topStories

Options:

topStoriesnewStoriesbestStoriesaskStoriesshowStoriesjobStoriesitemusersearch

Item IDs (mode=item)

itemIds

Optional

Direct Hacker News item IDs (numeric strings or integers). Used when mode=item.

Type:array

Default:

[]

Usernames (mode=user)

usernames

Optional

Hacker News usernames. Used when mode=user.

Type:array

Default:

[]

Search query (mode=search)

searchQuery

Optional

Free-text query passed to the Algolia HN search API.

Type:string

Start URLs (optional)

startUrls

Optional

Hacker News URLs to scrape directly. Supports news.ycombinator.com/item?id=N and news.ycombinator.com/user?id=USER. Each URL is converted to an item or user fetch.

Type:array

Default:

[]

Build comment tree

enableCommentHierarchy

Optional

When true, attach a nested comments[] array to each story (recursive replies). When false, comments are emitted as flat sibling records (one per row, with parentId and depth).

Type:boolean

Default:false

Max items

maxItems

Optional

Hard cap on emitted records (stories + comments + users combined).

Type:integer

Minimum:1

Maximum:500

Default:50

Max comments per story

maxComments

Optional

Cap on comments fetched per story. 0 = no comments. Default 0 (skip comments).

Type:integer

Minimum:0

Maximum:5000

Default:0

Max comment depth

maxDepth

Optional

Maximum reply depth when fetching comments (only applies when maxComments > 0). Root comments are depth 0.

Type:integer

Minimum:0

Maximum:20

Default:5

Min story score

minScore

Optional

Drop stories with fewer points than this. Comments are unaffected.

Type:integer

Minimum:0

Maximum:100000

Domain allowlist

domainAllowlist

Optional

Only emit stories whose URL host contains one of these substrings (case-insensitive). e.g. ['github.com','arxiv.org'].

Type:array

Default:

[]

Domain blocklist

domainBlocklist

Optional

Drop stories whose URL host contains one of these substrings. e.g. ['twitter.com','x.com'].

Type:array

Default:

[]

Exclude dead/deleted

excludeDeadOrDeleted

Optional

Drop items flagged dead: true or deleted: true by Hacker News.

Type:boolean

Default:true

Date range from (ISO YYYY-MM-DD)

dateRangeFrom

Optional

Drop items posted before this date (UTC). Empty = no lower bound.

Type:string

Date range to (ISO YYYY-MM-DD)

dateRangeTo

Optional

Drop items posted after this date (UTC). Empty = no upper bound.

Type:string

Min comment score

commentMinScore

Optional

Drop comments below this score. (Note: HN exposes comment scores only sporadically; comments without a score are kept.)

Type:integer

Minimum:0

Maximum:100000

Comment author allowlist

commentAuthorFilter

Optional

Only emit comments authored by one of these usernames (case-insensitive substring match).

Type:array

Default:

[]

Min number of comments

minCommentCount

Optional

Drop stories with fewer than this many comments.

Type:integer

Minimum:0

Maximum:100000

Hacker News Scraper

crawlerbros/hackernews-tech-stories-scraper

Crawler Bros

Hacker News Scraper

crawlerbros/hackernews-scraper

Scrape Hacker News stories, comments, jobs, and user profiles. Modes: top/new/best/ask/show/jobs/past/item/user/search. Filters: minScore, domainFilter, dateRange, commentMinScore. No proxy, no auth.

Crawler Bros

Hacker News Scraper — Stories, Jobs, Comments & Users API

bovi/hacker-news-scraper

Scrape Hacker News stories, comments, jobs, and user profiles via the official Firebase and Algolia APIs. No proxy, no auth. Supports top/new/best/ask/show/job feeds, full-text search, comment trees, and user data. Pay per result.

Vitalii Bondarev

Hacker News Scraper

cloud9_ai/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles via official Firebase API. Get top, new, best, ask, show stories with scores, comments, and author data.

cloud9

Hacker News Scraper: Stories, Comments, Users & Search

perconey/hackernews-scraper

Scrape Hacker News via the official Firebase API + Algolia search. Top/new/best/ask/show/jobs stories, full comment trees, user profiles with karma, free-text search. No browser, no proxies, no auth. Pay only per result item.

Perconey

Hacker News Scraper - Stories, Comments, Jobs, Users

piposlab/hacker-news-scraper

Scrape Hacker News via official APIs: top/new/best/Ask/Show/Jobs lists, full-text search, comment trees and user profiles. No API key.

Alejandro Bufarini

Hacker News Scraper — Stories, Comments & Profiles

lone_cipher/hacker-news-scraper

Scrape Hacker News stories, comment trees, and submitter profiles via the public Firebase API. No login, no auth, no rate limits. Six feed modes (top, new, best, ask, show, job).

Ian Bartholomew

Hacker News Scraper

leftwinglautus/hacker-news-scraper

Scrape Hacker News stories and users via the HN Firebase API and Algolia search API. Supports search, top, new, best, and user modes.

Moeeze Hassan

Hacker News Scraper

optimus-fulcria/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles. Top/new/best/ask/show/job stories, Algolia search, nested comments.

Fulcria Labs

Hacker News Scraper

noximilian/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles. Fetch top, new, best, ask, show, and job stories with full item details. Extract comments, user karma, and submission history.