Hacker News Scraper — Stories, Comments & Trends avatar

Hacker News Scraper — Stories, Comments & Trends

Pricing

$2.00 / 1,000 results

Go to Apify Store
Hacker News Scraper — Stories, Comments & Trends

Hacker News Scraper — Stories, Comments & Trends

Scrape Hacker News — front page stories, newest posts, job listings, and comments. Track trending tech topics and discussions.

Pricing

$2.00 / 1,000 results

Rating

0.0

(0)

Developer

Luan M.

Luan M.

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

8 hours ago

Last modified

Categories

Share

Hacker News Scraper — Top Stories, Points & Comments

Scrape Hacker News front page stories, newest posts, job listings, and comments. Track trending tech topics, upvote rankings, and discussion threads.

✨ Features

  • 📰 Extract stories from HN front page (top, new, show, ask, jobs)
  • 📊 Full rankings with points, authors, and comment counts
  • 🔗 Story URLs and HN discussion links
  • 🔄 Configurable post limits
  • 🌐 Apify proxy support for reliable scraping
  • ⚡ Built on Crawlee + Playwright for production-grade reliability

🚀 Quick Start

# Via Apify CLI
apify call hackernews-scraper
# Via API
curl -X POST "https://api.apify.com/v2/acts/N2FD4arChRWa0BSRB/runs" \
-H "Authorization: Bearer *** \
-H "Content-Type: application/json" \
-d '{"input": {"startUrls": [{"url": "https://news.ycombinator.com"}]}}'

📋 Input Parameters

FieldTypeDefaultDescription
startUrlsArrayHN homepageURLs to scrape (supports different feeds)
maxProductsInteger50Maximum stories to extract
proxyConfigurationObjectApify proxyProxy configuration

📊 Output

Structured JSON with per-story data:

FieldDescription
urlStory URL on HN
titlePost title
stories[]Array of extracted stories
stories[].titleHeadline
stories[].urlExternal link
stories[].rankPosition on page
stories[].pointsUpvote score
stories[].authorUsername
stories[].commentsComment count

💰 Pricing

  • Model: Pay per result (PAY_PER_EVENT)
  • Price: $0.01 per result
  • Free Tier: Apify provides $5 free monthly credit

📚 Use Cases

  • Startup & tech trend tracking
  • Developer community research
  • Content curation & newsletters
  • Competitive intelligence
  • Academic research on tech discourse

⚠️ Disclaimer

Respect Hacker News' terms of service and rate limits when scraping.