Hacker News Scraper
Pricing
from $1.00 / 1,000 dataset rows
Hacker News Scraper
Scrapes Hacker News by search, user, listing (front page/new/ask/show/jobs/best), or specific threads.
Hacker News Scraper
Pricing
from $1.00 / 1,000 dataset rows
Scrapes Hacker News by search, user, listing (front page/new/ask/show/jobs/best), or specific threads.
What to scrape: search results, a user's profile and submissions, a listing page (front page / newest / etc.), or specific threads.
Sort search results by relevance or by date. Only used when mode is search.
Restrict results to this item type, matching the hn.algolia.com search UI's tabs (it defaults to Stories, not everything). Only used when mode is search.
Hacker News username to scrape the profile and submissions of. Only used when mode is user.
Which listing to scrape. Only used when mode is listing.
HN thread URLs to scrape, e.g. https://news.ycombinator.com/item?id=1. Only used when mode is threads.
[]Whether to scrape the full comment tree for each thread. Only used when mode is threads.
Maximum number of items to output (0 = unlimited).
Maximum number of listing/search result pages to fetch (0 = unlimited). Not used in user or threads mode.