Pricing

Pay per usage

Hacker News Scraper

Scrape Hacker News stories, comments, and user data. Supports top/new/best/ask/show/job story feeds and full-text keyword search via the Algolia API. Extract titles, URLs, scores, authors, comment counts, and timestamps.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Monkey Coder

Actor stats

Bookmarked

Total users

Monthly active users

2 months ago

Last modified

📰 Hacker News Scraper

Scrape stories, comments, and user data from Hacker News — the tech community's most popular link aggregator.

✨ Features

Multiple feed modes: Top, New, Best, Ask HN, Show HN, and Job stories
Full-text search: Search stories by keyword via the Algolia HN Search API
User submissions: Fetch all stories submitted by a specific user
Optional comments: Include top-level comments for each story
No authentication required: Uses the official HN Firebase API and Algolia HN Search API

🔧 How It Works

Select a mode (top, new, best, ask, show, job, search, or user)
For search mode, provide a keyword query
For user mode, provide a HN username
Set the max results limit
Optionally enable top comments fetching (slower but richer data)

📋 Input Parameters

Parameter	Type	Description
`mode`	Select	Feed type: top, new, best, ask, show, job, search, or user
`query`	String	Search keyword (search mode only)
`username`	String	HN username (user mode only)
`search_sort`	Select	Sort by relevance or date (search mode only)
`max_results`	Integer	Maximum stories to return (1–500)
`include_comments`	Boolean	Fetch top-level comments per story
`request_timeout`	Integer	HTTP timeout in seconds

📦 Sample Output

{
    "id": 12345678,
    "title": "Show HN: I built an open-source AI tool",
    "url": "https://github.com/example/project",
    "score": 342,
    "author": "johndoe",
    "num_comments": 87,
    "created_at": "2026-03-23T10:30:00+00:00",
    "type": "story",
    "text": "",
    "hn_url": "https://news.ycombinator.com/item?id=12345678",
    "top_comments": [
        {
            "id": 12345679,
            "author": "janedoe",
            "text": "This is amazing! I've been looking for something like this.",
            "created_at": "2026-03-23T10:45:00+00:00"
        }
    ],
    "fetched_at": "2026-03-23T12:00:00+00:00"
}

📊 Modes

Mode	Description	Source
`top`	Current front-page stories ranked by score	Firebase API
`new`	Most recently submitted stories	Firebase API
`best`	Highest-voted stories of all time	Firebase API
`ask`	"Ask HN" discussion threads	Firebase API
`show`	"Show HN" project showcases	Firebase API
`job`	YC startup job postings	Firebase API
`search`	Full-text keyword search across all stories	Algolia API
`user`	All stories submitted by a specific user	Firebase API

⚡ Performance Notes

Feed modes (top/new/best/ask/show/job): Each story requires a separate API call. 100 stories ≈ 15–30 seconds.
Search mode: Uses Algolia's batch API, much faster. 100 results ≈ 2–5 seconds.
With comments enabled: Adds ~5 extra API calls per story. Expect 2–3× longer run times.
Rate limits: Both APIs are generous but the Actor includes retry logic for 429 responses.

🔗 Data Sources

Hacker News Firebase API — Official real-time data
Algolia HN Search API — Full-text search index

Hacker News Scraper

optimus-fulcria/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles. Top/new/best/ask/show/job stories, Algolia search, nested comments.

Fulcria Labs

Hacker News Scraper

cloud9_ai/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles via official Firebase API. Get top, new, best, ask, show stories with scores, comments, and author data.

cloud9

Hacker News Scraper

plantane/hackernews-scraper

Scrape stories, comments, and scores from Hacker News. Supports top, new, best, Ask HN, Show HN, and job feeds. Uses the official Firebase API for reliable, fast data extraction.

Daniel

Hacker News Enhanced Scraper - Stories, Comments & Search

hata1234/hn-scraper

Scrape Hacker News stories, comments, and search results via official Firebase and Algolia APIs. No proxy needed. Supports top, best, new, Ask HN, Show HN, job stories, full-text search, comment extraction, and advanced filtering by points, date, and domain.

Moris Chao

Hacker News Scraper: Stories, Comments, Users & Search

perconey/hackernews-scraper

Scrape Hacker News via the official Firebase API + Algolia search. Top/new/best/ask/show/jobs stories, full comment trees, user profiles with karma, free-text search. No browser, no proxies, no auth. Pay only per result item.

Perconey

Hacker News Scraper

vernacular_reservoir/hacker-news-scraper

Scrape Hacker News top, new, best, ask, show and jobs stories. Extract title, URL, score, author, comment count and age. Optionally include top comments. No API key required. Perfect for tech news monitoring and trend analysis.

Aleksandrs

Hacker News Scraper - Stories & Comments

pear_fight/hackernews-scraper

Scrape Hacker News stories, comments & user profiles. Extract titles, URLs, scores, comment counts, timestamps, full comment threads. Monitor trending tech topics in real time. Pay per result. Export JSON/CSV.

Harald

🔶 Hacker News Scraper — Stories & Tech Trends

nexgendata/hacker-news-scraper

Scrape Hacker News stories — top, new, best, ask, show, jobs. Engagement tracking, trend analysis, and tech topic monitoring.

Stephan Corbeil

Hacker News Scraper — Stories, Comments & User Profiles

junipr/hacker-news-scraper

Scrape HN stories, comments, and profiles via Firebase API. Get top/new/best/ask/show/job stories with scores, authors, timestamps. Full comment tree threading. User profiles with karma. Fast API-based.

junipr

Hacker News Scraper — Stories, Scores & Comments via Official A

sovereigntaylor/hackernews-scraper

Scrape Hacker News stories using the official Firebase API. Fetch top, new, best, ask, show, or job stories with title, URL, score, author, timestamp, and comment count. Optionally include top comments per story. Fast, reliable, no IP blocking — uses HN's public API. Perfect for tech trend monitorin