Pricing

$0.85 / 1,000 results

Try for free

Go to Apify Store

Lobste.rs Tech News and Engineering Stories Radar

Try for free

Extract Lobste.rs Tech News and Engineering Stories data in clean JSON or CSV. Query by feed, maxStories for records, engagement metrics, and metadata. Export datasets, run via API or Python/Node.js SDK, schedule runs, or integrate with webhooks with zero proxy fees.

Pricing

$0.85 / 1,000 results

Rating

0.0

(0)

Developer

Darim Quraishi

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Features

Scrapes the official Lobste.rs JSON endpoints tracking curated software engineering discussions.
Captures headline titles, original source links, community discussion URLs, and vote scores.
Collects comment thread counts, submitter usernames, and domain taxonomy tags.
Operates via public JSON endpoints with zero authentication tokens and zero proxy overhead.
Delivers clean structured records formatted for export to JSON, CSV, Excel, or technical newsletters.

Input parameters

Feed Selection: Choose between Hottest Stories or Newest Submissions. Default is hottest.
Maximum Stories: Maximum number of story records to collect, up to 50. Default is 25.

Output dataset fields

Each dataset record contains:

shortId: Short alphanumeric identifier (such as abc123).
title: Submission headline title.
url: External article link or primary discussion URL.
commentsUrl: Permanent link to the comments thread on lobste.rs.
score: Community net upvote score.
commentCount: Total replies posted to the discussion thread.
submitter: Username of the submitting developer.
tags: Array of technical classification tags (such as rust, security, or linux).
description: Editorial commentary or excerpt provided by the submitter.
createdAt: ISO formatted publication timestamp.
scrapedAt: UTC timestamp when the data was extracted.

Use cases

Developer newsletters: Curate weekly digests of deeply technical software discussions.
Engineering intelligence: Spot emerging compiler developments, kernel patches, and system architecture paradigms.
High-signal tech monitoring: Filter signal from noise by following invite-only developer community discussions.

Google News Scraper

muscular_quadruplet/google-news-scraper

Scrape Google News articles by keyword or topic. Get headlines, sources, publish dates, snippets. Monitor news mentions, track industry trends, build news aggregators. Real-time news scraping.

Do It

Lobsters Scraper — Tech Stories & Tags

openclawmara/lobsters-scraper

Scrape Lobsters (lobste.rs) tech news stories and tags. Extract story titles, URLs, scores, comments, authors, and tag categories. Filter by tag, date, or popularity. Perfect for niche tech trend analysis and developer news aggregation.

OpenClaw Mara

Lobsters Stories Scraper | JSON Export

trisert/lobsters

Scrape Lobsters front page stories with scores into structured JSON. Pay per result.

Nicola Destro

Hacker News Top Stories and Discussions Radar

adaptive_nightmare/hacker-news-stories-radar

Extract Hacker News Top Stories and Discussions data in clean JSON or CSV. Query by storyType, maxStories for records, engagement metrics, and metadata. Export datasets, run via API or Python/Node.js SDK, schedule runs, or integrate with webhooks with zero proxy fees.

Darim Quraishi

Open Trivia Database Quiz and Trivia Question Radar

adaptive_nightmare/open-trivia-db-quiz-radar

Extract Open Trivia Database Quiz and Trivia Question data in clean JSON or CSV. Query by amount, category, difficulty for records, engagement metrics, and metadata. Export datasets, run via API or Python/Node.js SDK, schedule runs, or integrate with webhooks with zero proxy fees.

Darim Quraishi

OSV Open Source Security Vulnerability Radar

adaptive_nightmare/osv-vulnerabilities-radar

Extract OSV Open Source Security Vulnerability data in clean JSON or CSV. Query by package, ecosystem, version for records, engagement metrics, and metadata. Export datasets, run via API or Python/Node.js SDK, schedule runs, or integrate with webhooks with zero proxy fees.

Darim Quraishi

Frankfurter Foreign Exchange and Currency Rates Radar

adaptive_nightmare/frankfurter-forex-radar

Extract Frankfurter Foreign Exchange and Currency Rates data in clean JSON or CSV. Query by baseCurrency, targetCurrencies for records, engagement metrics, and metadata. Export datasets, run via API or Python/Node.js SDK, schedule runs, or integrate with webhooks with zero proxy fees.

Darim Quraishi

CoinGecko Trending Coins and Search Queries Radar

adaptive_nightmare/coingecko-trending-coins-radar

Extract CoinGecko Trending Coins and Search Queries data in clean JSON or CSV. Query by includeCategories, maxCoins for records, engagement metrics, and metadata. Export datasets, run via API or Python/Node.js SDK, schedule runs, or integrate with webhooks with zero proxy fees.

Darim Quraishi

US Treasury Interest Rates and Fiscal Accounting Radar

adaptive_nightmare/us-treasury-fiscal-data-radar

Extract US Treasury Interest Rates and Fiscal Accounting data in clean JSON or CSV. Query by securityType, pageSize for records, engagement metrics, and metadata. Export datasets, run via API or Python/Node.js SDK, schedule runs, or integrate with webhooks with zero proxy fees.

Darim Quraishi

PyPI Package Download Statistics and Velocity Radar

adaptive_nightmare/pypi-download-stats-radar

Extract PyPI Package Download Statistics and Velocity data in clean JSON or CSV. Query by package for records, engagement metrics, and metadata. Export datasets, run via API or Python/Node.js SDK, schedule runs, or integrate with webhooks with zero proxy fees.

Darim Quraishi