Pricing

from $0.10 / 1,000 results

Hacker News Scraper

Scrape Hacker News stories, comments, and user data. Supports top/new/best/ask/show/job story feeds and full-text keyword search via the Algolia API. Extract titles, URLs, scores, authors, comment counts, and timestamps.

Pricing

from $0.10 / 1,000 results

Rating

0.0

(0)

Developer

Monkey Coder

Actor stats

Bookmarked

Total users

Monthly active users

15 days ago

Last modified

📰 Hacker News Scraper

Scrape stories, comments, and user data from Hacker News — the tech community's most popular link aggregator.

✨ Features

Multiple feed modes: Top, New, Best, Ask HN, Show HN, and Job stories
Full-text search: Search stories by keyword via the Algolia HN Search API
User submissions: Fetch all stories submitted by a specific user
Optional comments: Include top-level comments for each story
No authentication required: Uses the official HN Firebase API and Algolia HN Search API

🔧 How It Works

Select a mode (top, new, best, ask, show, job, search, or user)
For search mode, provide a keyword query
For user mode, provide a HN username
Set the max results limit
Optionally enable top comments fetching (slower but richer data)

📋 Input Parameters

Parameter	Type	Description
`mode`	Select	Feed type: top, new, best, ask, show, job, search, or user
`query`	String	Search keyword (search mode only)
`username`	String	HN username (user mode only)
`search_sort`	Select	Sort by relevance or date (search mode only)
`max_results`	Integer	Maximum stories to return (1–500)
`include_comments`	Boolean	Fetch top-level comments per story
`request_timeout`	Integer	HTTP timeout in seconds

📦 Sample Output

{
    "id": 12345678,
    "title": "Show HN: I built an open-source AI tool",
    "url": "https://github.com/example/project",
    "score": 342,
    "author": "johndoe",
    "num_comments": 87,
    "created_at": "2026-03-23T10:30:00+00:00",
    "type": "story",
    "text": "",
    "hn_url": "https://news.ycombinator.com/item?id=12345678",
    "top_comments": [
        {
            "id": 12345679,
            "author": "janedoe",
            "text": "This is amazing! I've been looking for something like this.",
            "created_at": "2026-03-23T10:45:00+00:00"
        }
    ],
    "fetched_at": "2026-03-23T12:00:00+00:00"
}

📊 Modes

Mode	Description	Source
`top`	Current front-page stories ranked by score	Firebase API
`new`	Most recently submitted stories	Firebase API
`best`	Highest-voted stories of all time	Firebase API
`ask`	"Ask HN" discussion threads	Firebase API
`show`	"Show HN" project showcases	Firebase API
`job`	YC startup job postings	Firebase API
`search`	Full-text keyword search across all stories	Algolia API
`user`	All stories submitted by a specific user	Firebase API

⚡ Performance Notes

Feed modes (top/new/best/ask/show/job): Each story requires a separate API call. 100 stories ≈ 15–30 seconds.
Search mode: Uses Algolia's batch API, much faster. 100 results ≈ 2–5 seconds.
With comments enabled: Adds ~5 extra API calls per story. Expect 2–3× longer run times.
Rate limits: Both APIs are generous but the Actor includes retry logic for 429 responses.

🔗 Data Sources

Hacker News Firebase API — Official real-time data
Algolia HN Search API — Full-text search index

Hacker News Scraper

lulzasaur/hn-scraper

Scrape Hacker News stories and comments. Get top, new, best, ask, show, and job stories via Firebase API. Full-text search via Algolia HN API. Includes scores, authors, timestamps.

lulz bot

Hacker News Scraper

optimus-fulcria/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles. Top/new/best/ask/show/job stories, Algolia search, nested comments.

Fulcria Labs

Hacker News Scraper

cloud9_ai/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles via official Firebase API. Get top, new, best, ask, show stories with scores, comments, and author data.

cloud9

Hacker News Scraper - Stories, Comments, Jobs, Users

piposlab/hacker-news-scraper

Scrape Hacker News via official APIs: top/new/best/Ask/Show/Jobs lists, full-text search, comment trees and user profiles. No API key.

Alejandro Bufarini

Hacker News Scraper

plantane/hackernews-scraper

Scrape stories, comments, and scores from Hacker News. Supports top, new, best, Ask HN, Show HN, and job feeds. Uses the official Firebase API for reliable, fast data extraction.

Daniel

Hacker News Enhanced Scraper - Stories, Comments & Search

hata1234/hn-scraper

Scrape Hacker News stories, comments, and search results via official Firebase and Algolia APIs. No proxy needed. Supports top, best, new, Ask HN, Show HN, job stories, full-text search, comment extraction, and advanced filtering by points, date, and domain.

Moris Chao

Hacker News Scraper: Stories, Comments, Users & Search

perconey/hackernews-scraper

Scrape Hacker News via the official Firebase API + Algolia search. Top/new/best/ask/show/jobs stories, full comment trees, user profiles with karma, free-text search. No browser, no proxies, no auth. Pay only per result item.

Perconey

Hacker News Scraper

rupom888/hackernews-scraper

Scrape stories, jobs, comments, and polls from Hacker News using the official HN Firebase API. Get top/new/best/ask/show stories with comments, search by keyword via Algolia HN Search API. Reliable and no rate limiting.

Syed Rupom

Hacker News Scraper

vernacular_reservoir/hacker-news-scraper

Scrape Hacker News top, new, best, ask, show and jobs stories. Extract title, URL, score, author, comment count and age. Optionally include top comments. No API key required. Perfect for tech news monitoring and trend analysis.

Aleksandrs

Hacker News Scraper - Stories & Comments

pear_fight/hackernews-scraper

Scrape Hacker News stories, comments & user profiles. Extract titles, URLs, scores, comment counts, timestamps, full comment threads. Monitor trending tech topics in real time. Pay per result. Export JSON/CSV.