Hacker News Scraper avatar

Hacker News Scraper

Pricing

from $2.00 / 1,000 results

Go to Apify Store
Hacker News Scraper

Hacker News Scraper

Scrape stories, jobs, comments, and polls from Hacker News using the official HN Firebase API. Get top/new/best/ask/show stories with comments, search by keyword via Algolia HN Search API. Reliable and no rate limiting.

Pricing

from $2.00 / 1,000 results

Rating

0.0

(0)

Developer

Syed Rupom

Syed Rupom

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a day ago

Last modified

Categories

Share

Extract stories, comments, and job postings from Hacker News. Scrape the front page, new stories, Ask HN, Show HN, or search by keyword. Priced at $0.50 per 1,000 results.

What it scrapes

  • Story title, URL, score (points), author, and post date
  • Comment count and direct HN link
  • Top-level comments per story (optional)
  • Job postings from the HN jobs section
  • Ask HN and Show HN posts

Sample output

{
"story_id": 40987654,
"title": "Show HN: I built a scraper that actually works",
"url": "https://example.com/my-project",
"hn_url": "https://news.ycombinator.com/item?id=40987654",
"score": 342,
"author": "pg",
"author_url": "https://news.ycombinator.com/user?id=pg",
"comment_count": 128,
"posted_at": "2024-01-15T14:32:00Z",
"type": "show",
"comments": [
{
"comment_id": 40987700,
"author": "tptacek",
"text": "This is impressive work...",
"posted_at": "2024-01-15T14:45:00Z"
}
]
}

Input

{
"scrapeType": "top",
"resultsWanted": 30,
"includeComments": true,
"maxCommentsPerStory": 10,
"minScore": 100
}
{
"scrapeType": "search",
"searchQuery": "machine learning startup",
"resultsWanted": 50
}

Input fields

FieldTypeDefaultDescription
scrapeTypestringtoptop, new, best, ask, show, jobs, search
searchQuerystringKeyword to search (search mode only)
resultsWantedinteger30Number of stories to return (up to 500)
includeCommentsbooleanfalseFetch top-level comments for each story
maxCommentsPerStoryinteger10Max comments per story (up to 50)
minScoreinteger0Minimum story score filter

Scrape types

scrapeTypeWhat it returns
topCurrent front page stories
newNewest submissions
bestAll-time highest scored
askAsk HN posts
showShow HN posts
jobsHN job postings
searchStories matching a keyword

Use cases

  • Tech trend monitoring: track emerging topics on HN
  • Startup research: find Show HN launches in a category
  • Job hunting: monitor HN monthly "Who is hiring?" threads
  • AI/LLM training data: collect high-quality discussions with scores as quality signal

Pricing

$0.50 per 1,000 results — HN is public, no API key needed.