Hacker News Scraper (stories + search) avatar

Hacker News Scraper (stories + search)

Pricing

$1.00 / 1,000 hacker news items

Go to Apify Store
Hacker News Scraper (stories + search)

Hacker News Scraper (stories + search)

Hacker News front page, newest, best, Ask HN, Show HN and job stories, plus full-text search with date sorting, from the official HN APIs. Clean story records: title, URL, points, comment count, author, time. Pay per item.

Pricing

$1.00 / 1,000 hacker news items

Rating

0.0

(0)

Developer

Will Vasquez

Will Vasquez

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

5 days ago

Last modified

Categories

Security

Limited permissions

Share

Collects Hacker News stories from the official Hacker News API and the Algolia HN Search API: the front page, newest, best, Ask HN, Show HN and job feeds, or a full-text search sorted by relevance or date. Every record is a clean story object with title, link, points, comment count, author and time, ready for dashboards, alerts, research or AI pipelines. No HTML scraping, no login, no proxies, so runs finish in seconds and you pay per story returned.

What it returns

One record per story:

FieldMeaning
idHN item ID
typestory, job, poll
titleStory title
urlLinked article URL (null for text posts such as Ask HN)
hnUrlThe discussion page on news.ycombinator.com
byPoster's HN handle
scorePoints
commentCountNumber of comments
timePosted time (ISO 8601)
textPost body for text posts, else null

Input

  • mode — top (front page, default), new, best, ask, show, job, or search.
  • query — required for search; full-text over titles and URLs.
  • sortBy — for search: relevance (default) or date.
  • maxItems — stop after this many stories (default 100, max 10,000). Feeds hold up to 500 current stories.

Output sample

{
"id": 8863,
"type": "story",
"title": "My YC app: Dropbox - Throw away your USB drive",
"url": "http://www.getdropbox.com/u/2/screencast.html",
"hnUrl": "https://news.ycombinator.com/item?id=8863",
"by": "dhouston",
"score": 104,
"commentCount": 71,
"time": "2007-04-04T19:16:40.000Z",
"text": null
}

Pricing

Pay per item. You are charged one item event for each story written to the dataset, nothing for empty feeds or searches with no hits.

Limits

  • Feeds return the current list (up to 500 IDs each); search pages through Algolia's results until maxItems.
  • Reads only the official APIs, identified as IntegraActor/1.0, at a polite rate; stops cleanly if an API rate-limits it.
  • Public data only. Handles are stored as HN publishes them and never aggregated across stories.