News Sites Data Scraper - NewsAPI Alternative avatar

News Sites Data Scraper - NewsAPI Alternative

Pricing

Pay per usage

Go to Apify Store
News Sites Data Scraper - NewsAPI Alternative

News Sites Data Scraper - NewsAPI Alternative

Scrape data from News Sites fast. Bulk URL or query input, structured JSON/CSV output, no login required. Free trial — perfect alternative to NewsAPI, MediaStack. Use for lead generation, market research, competitive analysis.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

fatih dağüstü

fatih dağüstü

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 days ago

Last modified

Categories

Share

Hacker News Scraper

Scrape Hacker News stories, comments, and user profiles. Search by keyword, filter by points/date, extract full discussions, and monitor new stories.

Features

  • Search Stories — Full-text search with relevance or date sorting
  • Front Page — Current front page stories
  • Show HN / Ask HN — Filter by post type
  • New Stories — Latest stories from HN
  • Story Comments — Full comment trees with depth tracking
  • User Profiles — Karma, about, and recent submissions

Input

FieldTypeDescription
scrapeTypestringsearch, front_page, new_stories, show_hn, ask_hn, story_comments, user_profile
searchQuerystringSearch keyword (for search mode)
searchSortstringrelevance or date
dateFromstringFilter stories after this date (YYYY-MM-DD)
dateTostringFilter stories before this date (YYYY-MM-DD)
storyIdsarrayStory IDs or URLs (for story_comments mode)
usernamesarrayHN usernames (for user_profile mode)
maxItemsnumberMaximum results (default: 100)
minPointsnumberMinimum points filter (default: 0)
minCommentsnumberMinimum comments filter (default: 0)

Output Examples

Story

{
"type": "story",
"id": 12345678,
"title": "Show HN: I built an AI tool",
"url": "https://example.com",
"hnUrl": "https://news.ycombinator.com/item?id=12345678",
"author": "pg",
"points": 256,
"numComments": 89,
"storyType": "show_hn",
"createdAt": "2024-01-15T10:30:00.000Z",
"scrapedAt": "2024-01-16T12:00:00.000Z"
}

Comment

{
"type": "comment",
"id": 87654321,
"storyId": 12345678,
"parentId": 12345678,
"author": "dang",
"text": "Great project!",
"depth": 0,
"childCount": 3,
"createdAt": "2024-01-15T11:00:00.000Z",
"scrapedAt": "2024-01-16T12:00:00.000Z"
}

User Profile

{
"type": "user_profile",
"username": "pg",
"karma": 156789,
"about": "Founder of YC",
"createdAt": "2007-02-19T00:00:00.000Z",
"submittedCount": 1234,
"scrapedAt": "2024-01-16T12:00:00.000Z"
}

Use Cases

  • Market Research — Track trending topics and technologies
  • Competitor Monitoring — Watch for mentions of competitors
  • Recruiting — Find active developers in specific domains
  • Content Ideas — Discover what resonates with tech audiences
  • Sentiment Analysis — Analyze discussion sentiment on topics

Data Sources

This scraper uses two official APIs:

  • Algolia HN API — For search, filtering, and comment trees
  • HN Firebase API — For new stories and user profiles

No browser required. Fast, lightweight, and reliable.

Cost

Uses Pay Per Event pricing. Each scraped item (story, comment, or profile) counts as one result.