Hacker News Data Scraper
epctex/hackernews-scraper
Extract Y Combinator's Hacker News based on any search criteria. Crawl the front page, Show HN, Ask HN, news, job listings, and historical data. Get links, titles, comments, ratings, and more!
Start URLs
startUrls
array
Optional
URLs to start with. It should be list or detail URL
Mode
mode
Enum
Optional
Select mode of the actor
Value options:
Enable Comment Hierarchy
enableCommentHierarchy
boolean
Optional
Enables comment hierarchy. If disabled, all comments will be on the same level.
Default value of this property is
false
Maximum number of listing items
maxItems
integer
Optional
Maximum number of listing items that you want as output. Default is all
List end page
endPage
integer
Optional
The page number that you want to end with. By default there is no end page.
Extend output function
extendOutputFunction
string
Optional
Function that takes a JQuery handle ($) as argument and returns data that will be merged with the default output
Proxy configuration
proxy
object
Required
Select proxies to be used by your crawler.
epctex
Maintained by Community
Build new tools
Enterprise solutions