Hacker News Scraper — Stories, Comments & User Profiles
Pricing
from $1.30 / 1,000 item scrapeds
Scrape HN stories, comments, and profiles via Firebase API. Get top/new/best/ask/show/job stories with scores, authors, timestamps. Full comment tree threading. User profiles with karma. Fast API-based.
What type of content to scrape from Hacker News. Choose a story feed (top, new, best, ask, show, jobs), search for content via Algolia, look up specific users, or fetch individual items by ID.
Maximum number of stories or items to return. Applies to story feeds and search results. Higher values take longer but return more data.
Fetch and include the full comment tree for each story. Disabling this significantly speeds up scraping when you only need story metadata.
Maximum number of comments to fetch per story. Comments are fetched in order of the thread tree (top-level first, then replies). Use lower values for faster runs.
Maximum depth of nested replies to follow in comment threads. Depth 1 = top-level comments only. Depth 5 = up to 4 levels of nested replies.
Search query string for finding stories and comments via the Algolia HN Search API. Required when scrapeType is 'search'. Supports standard search operators.
Filter search results by content type. Only applies when scrapeType is 'search'. Leave empty to search all content types.
List of HN usernames to look up. Required when scrapeType is 'user'. Returns profile info including karma, about text, and recent submissions.
List of HN item IDs to fetch directly. Required when scrapeType is 'item'. Accepts story, comment, job, poll, or poll option IDs.
Only include items with a score (upvotes) greater than or equal to this value. Useful for filtering out low-quality content.
Only include stories with at least this many comments (descendants). Useful for finding highly-discussed topics.
