Pricing

Pay per usage

Hacker News Scraper

Scrape Hacker News stories, comments, and user data. Supports top/new/best/ask/show/job story feeds and full-text keyword search via the Algolia API. Extract titles, URLs, scores, authors, comment counts, and timestamps.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Monkey Coder

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

📰 Hacker News Scraper

Scrape stories, comments, and user data from Hacker News — the tech community's most popular link aggregator.

✨ Features

Multiple feed modes: Top, New, Best, Ask HN, Show HN, and Job stories
Full-text search: Search stories by keyword via the Algolia HN Search API
User submissions: Fetch all stories submitted by a specific user
Optional comments: Include top-level comments for each story
No authentication required: Uses the official HN Firebase API and Algolia HN Search API

🔧 How It Works

Select a mode (top, new, best, ask, show, job, search, or user)
For search mode, provide a keyword query
For user mode, provide a HN username
Set the max results limit
Optionally enable top comments fetching (slower but richer data)

📋 Input Parameters

Parameter	Type	Description
`mode`	Select	Feed type: top, new, best, ask, show, job, search, or user
`query`	String	Search keyword (search mode only)
`username`	String	HN username (user mode only)
`search_sort`	Select	Sort by relevance or date (search mode only)
`max_results`	Integer	Maximum stories to return (1–500)
`include_comments`	Boolean	Fetch top-level comments per story
`request_timeout`	Integer	HTTP timeout in seconds

📦 Sample Output

{
    "id": 12345678,
    "title": "Show HN: I built an open-source AI tool",
    "url": "https://github.com/example/project",
    "score": 342,
    "author": "johndoe",
    "num_comments": 87,
    "created_at": "2026-03-23T10:30:00+00:00",
    "type": "story",
    "text": "",
    "hn_url": "https://news.ycombinator.com/item?id=12345678",
    "top_comments": [
        {
            "id": 12345679,
            "author": "janedoe",
            "text": "This is amazing! I've been looking for something like this.",
            "created_at": "2026-03-23T10:45:00+00:00"
        }
    ],
    "fetched_at": "2026-03-23T12:00:00+00:00"
}

📊 Modes

Mode	Description	Source
`top`	Current front-page stories ranked by score	Firebase API
`new`	Most recently submitted stories	Firebase API
`best`	Highest-voted stories of all time	Firebase API
`ask`	"Ask HN" discussion threads	Firebase API
`show`	"Show HN" project showcases	Firebase API
`job`	YC startup job postings	Firebase API
`search`	Full-text keyword search across all stories	Algolia API
`user`	All stories submitted by a specific user	Firebase API

⚡ Performance Notes

Feed modes (top/new/best/ask/show/job): Each story requires a separate API call. 100 stories ≈ 15–30 seconds.
Search mode: Uses Algolia's batch API, much faster. 100 results ≈ 2–5 seconds.
With comments enabled: Adds ~5 extra API calls per story. Expect 2–3× longer run times.
Rate limits: Both APIs are generous but the Actor includes retry logic for 429 responses.

🔗 Data Sources

Hacker News Firebase API — Official real-time data
Algolia HN Search API — Full-text search index

Hacker News Data Scraper

epctex/hackernews-scraper

Extract Y Combinator's Hacker News based on any search criteria. Crawl the front page, Show HN, Ask HN, news, job listings, and historical data. Get links, titles, comments, ratings, and more!

epctex

160

5.0

(7)

Hacker News Data Scraper & Activity Monitoring

lucen_data/hacker-news-data-scraper-activity-monitoring

Unofficial Hacker News API to extract data from all Hacker News categories. You can filter posts based on specific keywords, track trends using the unique activity monitoring feature, and receive updates directly in your Slack channel.

Lucen

Hackernews Scraper Pro

red.cars/hackernews-scraper-pro

NO PROXY REQUIRED | Enterprise-Grade Data Extraction | Tech Trend Analysis Extract comprehensive data from Hacker News without API keys or proxy configurations. Perfect for developer relations, competitive intelligence, startup research, and tech trend analysis.

AutomateLab

Hacker News Data Scraper

shahidirfan/hacker-news-data-scraper

Unlock the pulse of the tech world by scraping Hacker News effortlessly. Extract top stories, comments, and jobs from Y Combinator's platform. Perfect for market research, sentiment analysis, and staying ahead of startup trends with fast, structured data.

Shahid Irfan

Hacker News Scraper

nexgendata/hacker-news-scraper

Scrape stories from Hacker News including top, new, best, ask, show, and job stories. Returns titles, URLs, scores, comment counts, and optionally top-level comments. Uses the official HN Firebase API.

Stephan Corbeil

Hacker News Scraper

muscular_quadruplet/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles. Extract top stories, new posts, Show HN, Ask HN. Monitor tech trends, track discussions, build news aggregators. Real-time tech news scraping.

Do It

Hacker News Scraper — Stories, Comments & Jobs

cryptosignals/hackernews-scraper

Extract Hacker News stories, comments, job posts, and user profiles via Algolia API. Monitor trending topics, collect Show HN and Ask HN posts. Export to CSV, Excel, JSON. Works with Zapier, Make.com, Python, and JavaScript API. Free until April 3, then $4.99/mo.

CryptoSignals Agent

Hacker News Scraper & API - Export Stories, Comments, Data

fresh_cliff/hackernews-scraper

Extract top stories, trending posts, points, comments & authors from Hacker News front page. Real-time data export to JSON/CSV. Monitor tech trends, analyze viral content, track HN activity. Fast Playwright scraper.