Hacker News Scraper: Search, Feeds, Comments & Who's Hiring avatar

Hacker News Scraper: Search, Feeds, Comments & Who's Hiring

Pricing

$0.50 / 1,000 hn item (story, comment or job post)s

Go to Apify Store
Hacker News Scraper: Search, Feeds, Comments & Who's Hiring

Hacker News Scraper: Search, Feeds, Comments & Who's Hiring

Hacker News via the official Firebase API and the HN Algolia search API: keyword search (at least one query), live feeds and Who's Hiring posts. No login. Export JSON/CSV/Excel. Pay only per result.

Pricing

$0.50 / 1,000 hn item (story, comment or job post)s

Rating

0.0

(0)

Developer

Jeremy Yarbrough

Jeremy Yarbrough

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

15 days ago

Last modified

Share

Hacker News via the official Firebase API and the HN Algolia search API, with no login, no browser and no code. Export to JSON, CSV or Excel, or use the API.

Hacker News via the official Firebase API and the HN Algolia search API: keyword/brand mention search with date and points filters, top/new/best/Ask/Show feeds with ranks, comment threads, and parsed monthly 'Who is hiring' job posts (company, remote, visa, links).

Use cases

  • Brand/competitor mention monitoring on HN
  • Launch research: what Show HN posts hit the front page
  • Recruiting/sales leads from the monthly Who is hiring thread

Input

FieldTypeNotes
modestringsearch = keyword mentions; feed = live HN lists; whoishiring = parse the monthly hiring thread.
queriesarrayRequired in search mode (1 to 50): keywords, brands or domains. A search run with no queries stops right away with a clear error and is not charged. Not used in feed or whoishiring mode.
tagsstringsearch mode filter.
minPointsintegersearch mode.
dateFromstringYYYY-MM-DD (search mode).
dateTostringYYYY-MM-DD (search mode).
feedstringfeed mode list.
threadIdsarraywhoishiring mode, up to 12 thread ids; blank = latest thread.
maxItemsintegerTotal output cap.
includeCommentsbooleanAdd comment threads for stories.
maxCommentsPerStoryinteger

Which mode do I need?

  • search (default): finds stories or comments mentioning your queries. At least one query is required.
  • feed: the live top, new, best, Ask HN, Show HN or jobs list, in HN order. No queries needed.
  • whoishiring: parses the monthly "Who is hiring?" thread into job posts. No queries needed.

maxItems caps the total rows (and the cost) of every run.

Example input

{
"mode": "search",
"queries": [
"apify"
],
"maxItems": 5
}

Output

One dataset item per result. Main columns: type, rank, title, company, url, domain, author, points, numComments, createdAt, remote, hnUrl. A RUN_SUMMARY record is saved to the default key-value store. See the sample output in the Output tab.

Pricing

Pay per result, with no monthly rental or subscription:

  • HN item (story, comment or job post): $0.0005

Example: 1,000 results cost about $0.50 in fees. Apify's free plan includes $5 of monthly credit, which is enough to test this Actor.

FAQ

Do I need an account, cookies or a login for the source site? No. Hacker News Scraper uses public data sources only, so there is nothing to connect and no account to risk.

How much will a run cost? You pay only for results delivered (see Pricing above), plus Apify platform usage, which the free plan's monthly credit easily covers for test runs. Start with a small limit to see the exact cost per run.

Can I export to CSV, Excel or Google Sheets? Yes. Every run's dataset can be downloaded as JSON, CSV, Excel, XML or HTML, or pushed to Google Sheets, Make, Zapier, n8n, Slack or a webhook through Apify integrations.

Can I run it on a schedule or from my own code? Yes. Add an Apify Schedule (hourly, daily, weekly) or call it through the Apify API / Python & JavaScript clients. It also works with AI agents through the Apify MCP server.

What happens if an input is invalid or a source is down? The run keeps going. The bad input gets a row with an error field so you can see what failed, and you are not charged for results that were not delivered.

Is this legal to use? It collects publicly available data. You are responsible for using the output in line with the source's terms and privacy laws such as GDPR/CCPA; don't use it for spam.

Something missing or broken? Open an issue on the Issues tab. Feature requests are usually added within a few days.

Scheduling / monitoring

Create a Schedule (daily/weekly) and connect a webhook or Slack/email integration.

Fair use

Official public APIs only, no login. Do not use output for spam or harassment. Respect the data sources' rate limits and terms.

REST API

GET https://api.mediaprotools.com/v1/hacker-news-intel?items=... (header X-API-Key). Up to 5 items per call, separated by ,. Or POST {"items":[...],"options":{...}}.

ParameterTypeNotes
itemstokenKeywords, brands or domains to search for (required in search mode).
modestringsearch = keyword mentions; feed = live HN lists; whoishiring = parse the monthly hiring thread.
tagsstringsearch mode filter.
minPointsinteger 0-1000000search mode.
dateFromstringYYYY-MM-DD (search mode).
dateTostringYYYY-MM-DD (search mode).
feedstringfeed mode list.
threadIdsarraywhoishiring mode; blank = latest thread.
maxItemsinteger 1-100Total output cap.
includeCommentsbooleanAdd comment threads for stories.
maxCommentsPerStoryinteger 1-100Max comments per story

Output fields: author, createdAt, domain, hnUrl, id, numComments, parentId, points, query, storyId, text, title, type, url.