Pricing

Pay per usage

Hacker News Comment Scraper

Scrape nested Hacker News comments by story URL or keyword search. Extract author, timestamp, text, and reply trees. Built for developers building HN-powered integrations and analytics tools.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

pit 2017

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Features

Two modes: URL scrape or keyword search
Search via Algolia HN API — find stories by keyword
Extract: author, timestamp, comment text, nested reply trees
Lightweight: ~200MB image (vs Playwright's ~1GB+)
Fast: <5s for 50 comments
Reliable: requests + BeautifulSoup, no JavaScript rendering needed

Input

{
  "mode": "url",
  "storyUrl": "https://news.ycombinator.com/item?id=9999999",
  "maxComments": 50,
  "maxReplies": 5
}

Or search by keyword:

{
  "mode": "search",
  "searchQuery": "AI startup funding 2026",
  "maxComments": 50,
  "maxReplies": 5
}

Output

{
  "items": [
    {
      "author": "tptacek",
      "text": "The fundamental problem here is that...",
      "time": "2026-04-24T12:30:00",
      "depth": 0,
      "replies": [
        {"author": "jacquesm", "text": "I'd push back slightly on..."}
      ]
    }
  ]
}

Use Cases

Build HN analytics dashboards
Monitor discussions about your product/tech
Train datasets on developer discussions
Power HN-based recommendation engines
Content aggregation for newsletters

Deploy Your Own

# Install Apify CLI
npm install -g apify-cli

# Initialize
apify init --template python hackernews-comment-scraper
cd hackernews-comment-scraper

# Replace src/main.py with the code
# Update Dockerfile:
# FROM python:3.11-slim
# RUN pip install --no-cache-dir requests beautifulsoup4 lxml
# CMD ["python3", "src/main.py"]

# Push to Apify
apify actors push

Tutorial

Full tutorial article: ../../articles/hackernews-comment-scraper.md

License

MIT

Hacker News Scraper - Stories, Comments & Search

wetyr_corporation/hacker-news-scraper

Bulk extract Hacker News stories, comments, jobs, and Show HN. Search by keyword, filter by points and date. Powered by free Algolia HN API for unlimited reliability.

WETYR CORPORATION

Hacker News Scraper

parseforge/hacker-news-scraper

Extract stories, comments, and user data from Hacker News. Browse 6 feed types (Top, New, Best, Ask HN, Show HN, Jobs) or search with filters for points, comments, and date ranges. Get nested comment threads with depth control and author karma scores. Perfect for tech trends monitoring and analysis.

ParseForge

Hacker News Comments Scraper — Threads & Discussions

openclawmara/hackernews-comments-scraper

Scrape full comment trees from Hacker News stories. Extracts threaded discussions with author, text, points, depth, timestamp. Fetch by story ID, URL, or top/new stories. Ideal for sentiment analysis, tech discourse research, and developer community insights. Uses official Firebase API.

OpenClaw Mara

Hacker News Search — Stories, Comments & Developer Sentiment

ryanclinton/hackernews-search

Search and extract stories, comments, polls, Show HN, and Ask HN posts from Hacker News. This actor uses the Algolia HN Search API to find content by keyword, filter by author, date range, minimum points, and comment count -- then returns clean, structured JSON ready for analysis, monitoring, or ...

ryan clinton

Hacker News Scraper

gentle_cloud/hacker-news-scraper

Scrape Hacker News stories, comments, and user data. Supports top/new/best/ask/show/job story feeds and full-text keyword search via the Algolia API. Extract titles, URLs, scores, authors, comment counts, and timestamps.

Monkey Coder

Hacker News Scraper — Stories, Comments & Jobs

cryptosignals/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles — extract title, URL, score, author, comment threads, and submission time. CSV/JSON output.

Web Data Labs

Hacker News Data Scraper

epctex/hackernews-scraper

Extract Y Combinator's Hacker News based on any search criteria. Crawl the front page, Show HN, Ask HN, news, job listings, and historical data. Get links, titles, comments, ratings, and more!

epctex

163

5.0

Hacker News Scraper

coder_zoro/hacker-news-scraper

Extract Hacker News stories, Ask HN, Show HN & jobs. Multi-category scraping. Structured JSON output. Fast & reliable. Export to CSV/Excel/JSON.

Zoro

Hacker News MCP Server

nyxar_dev/hackernews-mcp

Read top stories, comments, and search Hacker News via MCP. Get real-time tech news, discussions, and trending topics from the HN community.

Nyxar Dev

📰 Hacker News Scraper

taroyamada/hacker-news-intelligence

Extract trending tech discussions, nested comment hierarchies, and post scores from Hacker News directly into structured JSON for custom RAG pipelines.