Hacker News Scraper — stories, comments, jobs, Who is hiring
Pricing
$0.20 / 1,000 stored item (story, comment, job or candidate)s
Hacker News Scraper — stories, comments, jobs, Who is hiring
Pricing
$0.20 / 1,000 stored item (story, comment, job or candidate)s
Which list to scrape. 'search' uses the query and filters below; 'whoishiring' parses the latest monthly 'Ask HN: Who is hiring?' (or 'Who wants to be hired?' / 'Freelancer?') thread into one row per post.
Full-text query for mode 'search' (matches title, URL, author and text). Leave empty to list by filters only.
Algolia tag filter for mode 'search': story, comment, poll, show_hn, ask_hn, front_page, job, author_, story_. Combine with commas (AND) or parentheses (OR), e.g. '(story,poll)' or 'comment,author_pg'. Default: story.
'relevance' = Algolia relevance + points; 'date' = newest first.
Only items created on or after this UTC date.
Only items created on or before this UTC date.
Only stories with at least this many upvotes.
Stop after this many story or job rows (comments are counted separately, see below). Lists hold up to 500 stories; search up to 5,000 hits.
For list and search modes: also store the comments of each story as 'comment' rows (oldest first, depth-limited).
1 = top-level comments only, 2 = plus direct replies, … Each comment row carries its 'depth'.
Cost control when 'Include comments' is on.
Which monthly thread to parse.