Hacker News Data Scraper avatar

Hacker News Data Scraper

Try for free

3 days trial then $10.00/month - No credit card required now

Go to Store
Hacker News Data Scraper

Hacker News Data Scraper

epctex/hackernews-scraper
Try for free

3 days trial then $10.00/month - No credit card required now

Extract Y Combinator's Hacker News based on any search criteria. Crawl the front page, Show HN, Ask HN, news, job listings, and historical data. Get links, titles, comments, ratings, and more!

Start URLs

startUrlsarrayOptional

URLs to start with. It should be list or detail URL

Mode

modeEnumOptional

Select mode of the actor

Value options:

"FRONTPAGE": string"NEWEST": string"ASK": string"SHOW": string"JOBS": string"PAST": string

Enable Comment Hierarchy

enableCommentHierarchybooleanOptional

Enables comment hierarchy. If disabled, all comments will be on the same level.

Default value of this property is false

Maximum number of listing items

maxItemsintegerOptional

Maximum number of listing items that you want as output. Default is all

List end page

endPageintegerOptional

The page number that you want to end with. By default there is no end page.

Extend output function

extendOutputFunctionstringOptional

Function that takes a JQuery handle ($) as argument and returns data that will be merged with the default output

Proxy configuration

proxyobjectRequired

Select proxies to be used by your crawler.

Developer
Maintained by Community

Actor Metrics

  • 4 monthly users

  • 5 stars

  • >99% runs succeeded

  • Created in Mar 2021

  • Modified 14 hours ago

Categories