Tech Content Scraper - Hacker News + Dev.to avatar

Tech Content Scraper - Hacker News + Dev.to

Pricing

from $1.00 / 1,000 content rows

Go to Apify Store
Tech Content Scraper - Hacker News + Dev.to

Tech Content Scraper - Hacker News + Dev.to

Hacker News discussions and Dev.to articles in one call. No API keys, no browser. Filter by query, tag, points or author. Sorted by engagement.

Pricing

from $1.00 / 1,000 content rows

Rating

0.0

(0)

Developer

ttgi

ttgi

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

19 days ago

Last modified

Categories

Share

Tech Content Scraper

Hacker News discussions and Dev.to articles in one call. No API keys, no browser, no login.

What you get

Hacker News via the Algolia HN Search API — title, author, points, comment count, URL, date. Filter by query, tag (story, front_page, ask_hn, show_hn), or a minimum score.

Dev.to via its public REST API — title, description, author, tags, reactions, comment count, reading time, language.

Results are merged, de-duplicated, and sorted by engagement so the most discussed content surfaces first.

Usage

{
"query": "rust", // HN search terms
"tags": "story", // or "front_page" for the front page
"tag": "python", // Dev.to tag
"minPoints": 50, // cut HN noise
"maxItems": 50
}

Use cases

  • Developer-intent keyword research — what developers actually discuss and search for, rather than what marketing pages claim
  • Content-gap analysis — high-engagement topics with no existing articles
  • Trend tracking — points and comment velocity over time
  • Community monitoring — a specific author's HN or Dev.to output
  • Newsletter sourcing — high-signal discussions worth writing about

Honest notes

  • The HN relevance search can return the same item on adjacent pages; rows are de-duplicated by source:id.
  • tags on HN rows are the Algolia filter tags (story, author_x), not content categories.
  • Rows are a common shape across two very different sources: an HN item has points/numComments and no reactionsCount; a Dev.to article is the reverse. Check which source before comparing.

Pronouns: they/them.