Hacker News Web Scraper

Scrape Hacker News (news.ycombinator.com) for stories, comments, and user profiles. Returns structured data including title, URL, score, author, timestamp, comment count, and full comment trees. Perfect for trend analysis, tech market research, and content monitoring.

Pricing

from $1.00 / 1,000 results

Rating

0.0

(0)

Developer

Wes Shields

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Features

Front page stories with scores and metadata
Full comment tree extraction with nesting
User profile scraping (karma, submissions)
Search by keyword across stories
"Ask HN" and "Show HN" filtering
Canonical URLs for every record
Structured JSON output

Use Cases

Tech trend and sentiment analysis
Startup and product launch monitoring
Content marketing intelligence
AI/ML training data collection
Competitive intelligence for tech companies

FAQ

Q: Is this scraping public data? A: Yes — Hacker News is a fully public site. This actor respects rate limits and robots.txt.

Q: Can I get historical data? A: The actor fetches current data. For historical HN data, consider pairing with the official HN Firebase API.

Q: How many stories per run? A: Configurable — default is the front page (30 stories). Can paginate through multiple pages.

Hacker News Scraper

vernacular_reservoir/hacker-news-scraper

Scrape Hacker News top, new, best, ask, show and jobs stories. Extract title, URL, score, author, comment count and age. Optionally include top comments. No API key required. Perfect for tech news monitoring and trend analysis.

Aleksandrs

Hacker News Scraper — Stories, Comments & Jobs

cryptosignals/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles — extract title, URL, score, author, comment threads, and submission time. CSV/JSON output.

Web Data Labs

Hacker News Search Scraper

sthiven_r/hacker-news-search-scraper

Search Hacker News by keyword and get stories (title, URL, points, comments, author, date). For tech monitoring & research.

Wilker Sthiven Rangel Manrique

Hacker News Scraper

originalvi/hacker-news-scraper

Search and scrape Hacker News stories and comments by keyword, author, date range, points, or comment count. Fast, official API, no browser.

Andrew Schneidwind

Hacker News Scraper — Stories, Comments & Users

openclawmara/hacker-news-scraper

Scrape Hacker News stories, comments, and user profiles. Extract trending tech news, top stories by score, new submissions, Ask HN, Show HN, and job posts. Filter by date, score, and comment count. Perfect for tech trend analysis, competitive intelligence, and content curation.

OpenClaw Mara

Hacker News Scraper - Stories & Comments

pear_fight/hackernews-scraper

Scrape Hacker News stories, comments & user profiles. Extract titles, URLs, scores, comment counts, timestamps, full comment threads. Monitor trending tech topics in real time. Pay per result. Export JSON/CSV.