Hacker News Scraper: Stories, Comments & Who is Hiring avatar

Hacker News Scraper: Stories, Comments & Who is Hiring

Pricing

$0.20 / 1,000 item results

Go to Apify Store
Hacker News Scraper: Stories, Comments & Who is Hiring

Hacker News Scraper: Stories, Comments & Who is Hiring

Get Hacker News stories, comments and monthly "Who is hiring" posts from the official HN APIs. Optionally return only items that are new since your last run.

Pricing

$0.20 / 1,000 item results

Rating

0.0

(0)

Developer

Lepi Data

Lepi Data

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 days ago

Last modified

Share

What it does. Pulls Hacker News content from the official APIs: Top, New, Best, Ask HN, Show HN and Job story lists, keyword search over stories, all comments of one story, and top-level posts from the monthly "Ask HN: Who is hiring?" thread. With Only items new since last run on, the tool remembers the highest item id it returned for each mode and query, and skips older items next time. That makes it easy to schedule.

Input (from .actor/input_schema.json)

  • mode (required): top | new | best | ask | show | job | search | comments | hiring (default top)
  • query: search keyword (mode search)
  • storyId: HN item id (required for comments; optional for hiring, default is the latest Who is hiring thread)
  • maxItems: 1–5000, default 30. Maximum rows returned and paid for.
  • sinceLastRun: boolean, default false
  • stateStoreName: named key-value store for the since-last-run cursor, default lepidata-hacker-news-state

Output fields

  • All rows: type, id, title, url, author (HN username), points, commentsCount, parentId, storyId, createdAt, hnUrl
  • Stories and comments: text (as written)
  • Hiring posts (type: hiring-post): postText (exactly as written), company (first segment of the header line), headerLine (header line with emails, URLs and phone numbers removed), remote (true/false/null)
  • Free status rows (not charged): no-new-items, invalid-input, api-error, free-plan-limit, charge-limit-reached, each with errorCode/message

Example Input: {"mode":"hiring","maxItems":50,"sinceLastRun":true} Output row (illustrative shape): {"type":"hiring-post","id":…,"company":"ExampleCo","headerLine":"ExampleCo | Senior Backend Engineer | Remote (US)","remote":true,"postText":"ExampleCo | Senior Backend Engineer | Remote (US) | …","author":"exampleuser","hnUrl":"https://news.ycombinator.com/item?id=…"} If nothing new has been posted since the last run, you get one free no-new-items row and are not charged.

Data source and compliance

  • Data comes only from the official Hacker News API (Firebase) and the Algolia HN Search API. No key, no login and no page scraping.
  • Post text is returned exactly as written. The tool never extracts emails, phone numbers or real names into contact fields, and contact-like segments are removed from company and headerLine. Usernames appear as HN shows them.
  • Retries with backoff on HTTP 429 and 5xx errors.
  • You are responsible for lawful use of the data.
  • Free-plan accounts get up to 100 results per run.

Pricing. Pay per result: $0.20 per 1,000 results, flat on every plan, no start fee. Free status rows are never charged.