Hacker News Scraper — search, front page, comments & users avatar

Hacker News Scraper — search, front page, comments & users

Pricing

from $1.50 / 1,000 results

Go to Apify Store
Hacker News Scraper — search, front page, comments & users

Hacker News Scraper — search, front page, comments & users

Turn Hacker News into structured data: full-text search all of HN history, pull the live top/new/best/ask/show/job front pages, fetch a story with its full comment thread, or get user profiles. No login — uses HN's public Algolia + Firebase APIs.

Pricing

from $1.50 / 1,000 results

Rating

0.0

(0)

Developer

Vincent Kirui

Vincent Kirui

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

4 days ago

Last modified

Categories

Share

Turn Hacker News into clean, structured, agent-ready data — no login, no API keys. Built on HN's official public APIs (Algolia HN Search + the Firebase v0 API), so it's fast, reliable, and legal for public data. Four modes in one actor:

ModeWhat you getUse it for
SearchFull-text search across all of HN history — filter by points, recency, tagsBrand / competitor / keyword monitoring, sentiment, market research
Front page listThe live top / new / best / ask / show / job storiesTrend tracking, daily digests, "what's hot in tech right now"
Item + commentsA story plus its entire comment thread, flattenedDeep discussion analysis, community sentiment, dataset building
UsersA user's profile, karma, and activityInfluencer / contributor research

Why it's built for AI agents

Exposed as an MCP tool, this lets an agent answer "what is Hacker News saying about X?" in one call — search a topic, pull the discussion, read the comment thread. Structured JSON out, no scraping fragility.

Output

Clean, flat rows (CSV/Excel/JSON/API). Stories include title, url, points, num_comments, author, created_at, text, and a direct hn_url. Comments include text, author, story_id, parent_id. Users include karma, about, created_at.

Input examples

{ "mode": "search", "query": "your product", "minPoints": 50, "sinceDays": 30, "maxItems": 500 }
{ "mode": "list", "listType": "top", "maxItems": 100 }
{ "mode": "item", "itemIds": ["44444444"], "includeComments": true }
{ "mode": "user", "usernames": ["pg", "dang"] }

Uses Hacker News's public, documented APIs (Algolia + Firebase). No login, no cookies, no circumvention. You're responsible for using the data within applicable law.

Pricing

Pay-per-event: a small actor-start fee plus a per-item charge for each story / comment / user returned — you pay for exactly the data you pull.