Hacker News Data Scraper

3 days trial then $10.00/month - No credit card required now

Hacker News Data Scraper

Hacker News Data Scraper

epctex/hackernews-scraper

3 days trial then $10.00/month - No credit card required now

Extract Y Combinator's Hacker News based on any search criteria. Crawl the front page, Show HN, Ask HN, news, job listings, and historical data. Get links, titles, comments, ratings, and more!

Start URLs

startUrls
array
Optional

URLs to start with. It should be list or detail URL

Mode

mode
Enum
Optional

Select mode of the actor

Value options:

"FRONTPAGE": string"NEWEST": string"ASK": string"SHOW": string"JOBS": string"PAST": string

Enable Comment Hierarchy

enableCommentHierarchy
boolean
Optional

Enables comment hierarchy. If disabled, all comments will be on the same level.

Default value of this property is

false

Maximum number of listing items

maxItems
integer
Optional

Maximum number of listing items that you want as output. Default is all

List end page

endPage
integer
Optional

The page number that you want to end with. By default there is no end page.

Extend output function

extendOutputFunction
string
Optional

Function that takes a JQuery handle ($) as argument and returns data that will be merged with the default output

Proxy configuration

proxy
object
Required

Select proxies to be used by your crawler.

Developer
Maintained by Community
Actor stats
  • 52 users
  • 3.1k runs
  • Modified about 2 hours ago

You might also like these Actors