Pricing

from $0.005 / story scraped

HackerNews Insights Scraper — Stories, Comments & Velocity

Hacker News stories, full comment trees, user karma and contact info, story velocity tracking, history deltas. Search all 3.7M stories with filters for points, karma, domain, dates, keywords. For VCs hunting Show HN, recruiters mining talent, journalists tracking tech, and AI/RAG pipelines.

Pricing

from $0.005 / story scraped

Rating

0.0

(0)

Developer

Yuliia Kulakova

Actor stats

Bookmarked

Total users

Monthly active users

6 days ago

Last modified

tags

Optional

Restrict search results to specific HN tags. Only applied when 'queries' is non-empty or 'algoliaTagsOnly' is true.

Type:string[]

Default:

[]

Search by tags only (no query needed)

tagSearchOnly

Optional

When checked, the scraper runs a tag-only search using the 'tags' field above — useful for fetching, say, 'all Show HN posts with > 100 points'. No 'queries' needed.

Type:boolean

Default:false

Story IDs

storyIds

Optional

Direct Hacker News story IDs to fetch (https://news.ycombinator.com/item?id=XXX).

Type:array

Default:

[]

User IDs

userIds

Optional

Hacker News usernames to enrich (returns karma, about, contact info, dominant topics, submission velocity).

Type:array

Default:

[]

Minimum points (score)

minPoints

Optional

Skip stories below this score. 0 = no filter.

Type:integer

Minimum:0

Default:0

Minimum comments

minComments

Optional

Skip stories with fewer comments than this. 0 = no filter.

Type:integer

Minimum:0

Default:0

Minimum author karma

minAuthorKarma

Optional

Skip stories whose author karma is below this. Requires extra user lookups (slower).

Type:integer

Minimum:0

Default:0

From date (ISO YYYY-MM-DD)

dateFrom

Optional

Only include stories submitted on/after this date.

Type:string

Default:

To date (ISO YYYY-MM-DD)

dateTo

Optional

Only include stories submitted on/before this date.

Type:string

Default:

Keywords (any-match, OR)

keywords

Optional

Filter stories whose title contains ANY of these keywords (case-insensitive). Applied after fetch.

Type:array

Default:

[]

URL domains filter

domains

Optional

Only keep stories whose URL domain matches one of these (e.g. 'arxiv.org', 'github.com'). Self-posts (Ask HN, Show HN text) skipped when this is set.

Type:array

Default:

[]

Include full comment trees

includeComments

Optional

Fetch every comment under each story (charged per comment). Off by default to keep costs predictable.

Type:boolean

Default:false

Max comment depth

commentDepth

Optional

Limit recursion depth for comment trees. 1 = top-level only, 3 = top + 2 reply tiers.

Type:integer

Minimum:1

Maximum:10

Default:3

Max comments per story

maxCommentsPerStory

Optional

Hard cap on the number of comments fetched per story (after depth filter). Protects cost on viral threads.

Type:integer

Minimum:0

Default:200

Enrich with author profiles

includeAuthorProfiles

Optional

Add a user record per story author (karma, about, contact info, dominant topics).

Type:boolean

Default:false

Max stories per list

maxStoriesPerList

Optional

Cap stories taken from each live list (top/best/new/ask/show/job).

Type:integer

Minimum:1

Maximum:500

Default:30

Max stories per query

maxStoriesPerQuery

Optional

Cap stories returned per Algolia search query.

Type:integer

Minimum:1

Maximum:1000

Default:50

Algolia sort

sortBy

Optional

Algolia search ranking. 'popularity' = highest engagement first. 'date' = newest first.

Type:string

Default:popularity

Options:

popularitydate

Compute story analytics

includeAnalytics

Optional

Add per-story velocity (pointsPerHour, commentsPerHour), comment tree depth, top commenters, domain stats.

Type:boolean

Default:true

Extract user contact info

includeContactInfo

Optional

Scan user.about for emails, Twitter/X handles, GitHub, LinkedIn, websites. Applied to author profiles and userIds.

Type:boolean

Default:true

Track score/comment growth across runs

enableHistory

Optional

Persist a per-story snapshot of score and comment count between runs. Each story output then includes 'history.delta' (scoreDelta, commentsDelta, scorePerHour, isNew). Stored in the 'hackernews-history' KV store.

Type:boolean

Default:false

History KV store name

historyStoreName

Optional

Named key-value store for history snapshots.

Type:string

Default:hackernews-history

Concurrency

maxConcurrency

Optional

Maximum parallel fetches (item + comment lookups).

Type:integer

Minimum:1

Maximum:20

Default:6

Per-request throttle (ms)

minDelayMs

Optional

Floor delay between requests per worker. Firebase tolerates very high rates; default is conservative.

Type:integer

Minimum:0

Maximum:5000

Default:30

Proxy configuration

proxyConfiguration

Optional

Optional. Proxies are included and configured automatically — leave this empty.

Type:object

Hacker News Scraper — Stories, Comments & User Profiles

junipr/hacker-news-scraper

Scrape HN stories, comments, and profiles via Firebase API. Get top/new/best/ask/show/job stories with scores, authors, timestamps. Full comment tree threading. User profiles with karma. Fast API-based.

junipr

Hacker News Enhanced Scraper - Stories, Comments & Search

hata1234/hn-scraper

Scrape Hacker News stories, comments, and search results via official Firebase and Algolia APIs. No proxy needed. Supports top, best, new, Ask HN, Show HN, job stories, full-text search, comment extraction, and advanced filtering by points, date, and domain.

Moris Chao

Hackernews Scraper

fortuitous_pirate/hackernews-scraper

Extract stories, jobs, Ask HN, and Show HN posts from Hacker News. Get top stories, best stories, job listings, or search by keyword. Returns title, URL, score, comment count, author, and timestamp. Free API — no authentication required.

Fortuitous Pirate

Hacker News Scraper

parseforge/hacker-news-scraper

Extract stories, comments, and user data from Hacker News. Browse 6 feed types (Top, New, Best, Ask HN, Show HN, Jobs) or search with filters for points, comments, and date ranges. Get nested comment threads with depth control and author karma scores. Perfect for tech trends monitoring and analysis.

ParseForge

Hacker News Scraper: Stories, Comments, Users & Search

perconey/hackernews-scraper

Scrape Hacker News via the official Firebase API + Algolia search. Top/new/best/ask/show/jobs stories, full comment trees, user profiles with karma, free-text search. No browser, no proxies, no auth. Pay only per result item.

Perconey

Hacker News Scraper — Stories, Comments & Users

openclawmara/hacker-news-scraper

Scrape Hacker News stories, comments, and user profiles. Extract trending tech news, top stories by score, new submissions, Ask HN, Show HN, and job posts. Filter by date, score, and comment count. Perfect for tech trend analysis, competitive intelligence, and content curation.

OpenClaw Mara

Reddit Scraper

velvety_bedbug/reddit-scraper

Scrape stories and comments from Hacker News via the Algolia API. Search by query, filter by points, date, and type (stories, Ask HN, Show HN).

Peters Bugs

🟧 Hacker News Scraper — Stories, Comments & Search by Keyword

iskoren/hacker-news-scraper

Search and scrape Hacker News stories, comments, and polls by keyword — points, authors, comment counts, dates, and links. Powered by the official HN API.

Is Koren

Hacker News Scraper - Stories, Comments & Search

wetyr_corporation/hacker-news-scraper

Bulk extract Hacker News stories, comments, jobs, and Show HN. Search by keyword, filter by points and date. Powered by free Algolia HN API for unlimited reliability.

WETYR

Hacker News Stories, Comments & Users Scraper

crawlerbros/hacker-news-scraper

Scrape Hacker News - search stories and comments, fetch top/new/best stories, get user profiles and submission history. Uses the official Algolia HN Search API and Hacker News Firebase API.