Hacker News Scraper - Stories & Comments avatar

Hacker News Scraper - Stories & Comments

Pricing

from $1.50 / 1,000 results

Go to Apify Store
Hacker News Scraper - Stories & Comments

Hacker News Scraper - Stories & Comments

Scrape Hacker News stories, comments & user profiles. Extract titles, URLs, scores, comment counts, timestamps, full comment threads. Monitor trending tech topics in real time. Pay per result. Export JSON/CSV.

Pricing

from $1.50 / 1,000 results

Rating

0.0

(0)

Developer

Harald

Harald

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

0

Monthly active users

17 days ago

Last modified

Categories

Share

Hacker News Scraper

Fast and reliable Hacker News scraper using the official Firebase API. Extract stories from top, new, best, Ask HN, and Show HN with full metadata.

Features

  • 🚀 Uses official Hacker News Firebase API (no parsing, 100% reliable)
  • 📊 Multiple story types: top, new, best, ask, show
  • 💬 Includes comment counts
  • ⚡ Fast and efficient
  • 📦 Clean, structured data output

Input

  • Story Type (required): Type of stories to scrape

    • top - Top Stories
    • new - New Stories
    • best - Best Stories
    • ask - Ask HN
    • show - Show HN
  • Maximum Items (default: 30): Number of stories to scrape (1-500)

  • Include Comment Count (default: true): Whether to fetch comment counts

Output

Each story contains:

  • id - Unique story ID
  • title - Story title
  • url - Story URL (or HN discussion URL for text posts)
  • score - Story points/score
  • author - Username of the author
  • time - Unix timestamp
  • timestamp - ISO 8601 timestamp
  • type - Story type (story, ask, show, etc.)
  • text - Story text content (for Ask HN, Show HN, etc.)
  • commentsCount - Number of comments

Example Output

{
"id": 39526341,
"title": "Show HN: I built a tool to visualize algorithm complexity",
"url": "https://example.com/algorithm-viz",
"score": 847,
"author": "developer123",
"time": 1708520400,
"timestamp": "2024-02-21T12:00:00.000Z",
"type": "story",
"text": null,
"commentsCount": 142
}

Use Cases

  • Monitor trending tech discussions
  • Track Ask HN and Show HN launches
  • Analyze discussion patterns
  • Build HN aggregators or newsletters
  • Research topic trends

API Rate Limits

Uses the official Hacker News API which has no rate limits. Respectful usage is encouraged.

Support

For issues or questions, please open an issue on GitHub or contact support.