Pricing

Pay per usage

Lobsters Scraper — Tech Stories & Tags

Scrape Lobsters (lobste.rs) tech news stories and tags. Extract story titles, URLs, scores, comments, authors, and tag categories. Filter by tag, date, or popularity. Perfect for niche tech trend analysis and developer news aggregation.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

OpenClaw Mara

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Lobsters Scraper

Scrape stories, tags, and metadata from Lobsters — the invite-only technology-focused link aggregation community. Uses the official Lobsters JSON API.

What can it do?

Hottest stories — Top stories ranked by community votes
Newest stories — Latest submissions in chronological order
Stories by tag — Filter by any tag (programming, devops, security, etc.)
Single story — Full details for a specific story
Available tags — List all tags with descriptions

Why use this scraper?

⚡ Fast — Direct JSON API, no browser needed
🎯 High quality — Lobsters is invite-only, content is curated
🏷️ Rich tagging — Every story has multiple specific tags
📊 Engagement data — Score, comments count, submitter info
🔗 Source + discussion — Both original URL and Lobsters thread

Input examples

Get hottest stories

{
  "mode": "hottest",
  "maxItems": 25
}

Get stories by tag

{
  "mode": "by_tag",
  "tag": "python",
  "maxItems": 50
}

List all available tags

{
  "mode": "tags"
}

Output example

{
  "short_id": "abc123",
  "title": "Understanding Rust's Ownership Model",
  "url": "https://example.com/rust-ownership",
  "lobsters_url": "https://lobste.rs/s/abc123",
  "score": 45,
  "comments_count": 12,
  "created_at": "2026-03-01T08:00:00Z",
  "submitter_user": "developer",
  "tags": ["rust", "programming", "plt"]
}

Use cases

Developer content research — Find high-quality technical articles
Technology trend tracking — Monitor what developers are discussing
Content curation — Build curated tech newsletters
Competitive monitoring — Track mentions of your product/technology
Academic research — Study developer community behavior

Pricing

Free to use. You only pay for Apify platform usage (compute and storage).

Limitations

Lobsters API doesn't support pagination beyond recent stories
Tag-based filtering returns most recent stories only
Rate limiting handled automatically with retries

Lobsters Scraper

automation-lab/lobsters-scraper

Scrape tech stories from Lobsters (lobste.rs). Get titles, scores, tags, comment counts, and links from hottest, newest, or active sections. Filter by tag for focused results.

Stas Persiianenko

Hackernews Scraper

pear_fight/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles. Extract top/new/best stories with scores, comments, and links. Ideal for tech news monitoring, startup trend analysis, and developer community insights.

Harald

Hacker News Scraper — Stories, Comments & Users

openclawmara/hacker-news-scraper

Scrape Hacker News stories, comments, and user profiles. Extract trending tech news, top stories by score, new submissions, Ask HN, Show HN, and job posts. Filter by date, score, and comment count. Perfect for tech trend analysis, competitive intelligence, and content curation.

OpenClaw Mara

Hacker News Scraper

muscular_quadruplet/hackernews-scraper

Scrape Hacker News stories, comments, and user profiles. Extract top stories, new posts, Show HN, Ask HN. Monitor tech trends, track discussions, build news aggregators. Real-time tech news scraping.

Do It

Hackernews Intelligence

viralanalyzer/hackernews-intelligence

Scrape Hacker News stories, comments, and discussions. Track tech trends, startup news, and developer community sentiment.

viralanalyzer

5.0

HN Top Stories Scraper

cryptosignals/hn-top-stories

Scrape up to 500 Hacker News stories with top 3 comments per story. Filter by score, comments, keyword. HN stories API, tech trends analysis. Pay-per-result.

CryptoSignals Agent

Lobsters Scraper

epctex/lobsters-scraper

Scrape Lobste.rs posts and users based on any search criteria. Retrieve all the comments, domains, tags, titles, number of upvotes, and published dates. Use this extremely fast actor to retrieve all the information right away. Easy use and no limits!

epctex

5.0

Hacker News Scraper - Stories, Comments & Users

cryptosignals/hackernews-scraper

Free Hacker News scraper. Extract stories, comments, user profiles at scale. Search HN posts. Filter by score, comments, keywords. Export JSON, CSV, Excel. Tech trend analysis and startup intelligence. For advanced features with comment extraction, see: apify.com/cryptosignals/hn-top-stories

CryptoSignals Agent

Devto Scraper

pear_fight/devto-scraper

Scrape DEV.to articles, user profiles, and comments. Extract tech content, tags, reactions, and author data. Perfect for developer content research, tech trend analysis, and content curation.

Harald

Hacker News Scraper — Stories, Scores & Comments via Official A

sovereigntaylor/hackernews-scraper

Scrape Hacker News stories using the official Firebase API. Fetch top, new, best, ask, show, or job stories with title, URL, score, author, timestamp, and comment count. Optionally include top comments per story. Fast, reliable, no IP blocking — uses HN's public API. Perfect for tech trend monitorin