Pricing

$5.00 / 1,000 result scrapeds

Lobsters Scraper - Tech News & Discussions

Scrape Lobste.rs tech news stories. Get titles, scores, tags, comments, and authors from the front page, newest, or search results.

Pricing

$5.00 / 1,000 result scrapeds

Rating

0.0

(0)

Developer

lulz bot

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Lobsters Scraper

Extract tech news stories from Lobste.rs — the invite-only tech community. Get titles, URLs, scores, tags, comments, and author information.

Features

Front page — scrape the current front page stories
Newest — get the latest submitted stories
Hottest — scrape the hottest stories
By tag — filter stories by tag (e.g., "python", "security", "devops")
Search — search stories by keyword
Pagination — scrape multiple pages for more results

Input

Field	Type	Description
`mode`	string	"front", "newest", "hottest", "tag", or "search" (default: "front")
`searchQuery`	string	Search query (only for "search" mode)
`tag`	string	Tag name (only for "tag" mode, e.g. "python", "security")
`maxResults`	number	Max stories to return (default: 50)
`maxPages`	number	Max pages to scrape (default: 2)

Output

Each story includes:

{
    "title": "Why Rust is great for CLI tools",
    "url": "https://example.com/article",
    "domain": "example.com",
    "score": 42,
    "commentCount": 15,
    "author": "username",
    "tags": ["rust", "programming"],
    "submittedAt": "2026-04-26T10:00:00Z",
    "commentUrl": "https://lobste.rs/s/abc123",
    "shortId": "abc123",
    "scrapedAt": "2026-04-26T12:00:00Z"
}

Use Cases

Tech trend monitoring — track what the developer community is discussing
Content curation — find top-rated technical articles and discussions
Competitive intelligence — monitor mentions of technologies and products
Research — analyze developer community sentiment on tech topics
Newsletter content — curate high-quality technical articles

Pricing

This actor uses pay-per-event pricing at $0.005 per result scraped.

Lobsters Scraper | Tech News and Discussions

parseforge/lobsters-scraper

Scrape tech stories from Lobsters including titles, links, tags, scores, comment counts, submitters and timestamps. Build datasets of developer-focused news and discussions for trend analysis, content curation and technology research projects at scale across the full catalog

ParseForge

Lobsters Scraper — Tech Stories & Tags

openclawmara/lobsters-scraper

Scrape Lobsters (lobste.rs) tech news stories and tags. Extract story titles, URLs, scores, comments, authors, and tag categories. Filter by tag, date, or popularity. Perfect for niche tech trend analysis and developer news aggregation.

OpenClaw Mara

Hacker News Comments Scraper — Threads & Discussions

openclawmara/hackernews-comments-scraper

Scrape full comment trees from Hacker News stories. Extracts threaded discussions with author, text, points, depth, timestamp. Fetch by story ID, URL, or top/new stories. Ideal for sentiment analysis, tech discourse research, and developer community insights. Uses official Firebase API.

OpenClaw Mara

Lobsters Scraper - Developer News & Stories Extractor

klondikeking/lobsters-scraper

Extract stories, votes, comments, and metadata from the Lobsters developer news community. Clean JSON API — no proxy needed.

Pierrick McD0nald

Lobsters Scraper

crawlerbros/lobsters-scraper

Scrape Lobsters (lobste.rs) â€" a curated tech link aggregator. Fetch hottest, newest, or tag-filtered stories with scores, comments, tags, and author info. No authentication required.

Crawler Bros

Hacker News Scraper: Stories, Comments, Users & Search

perconey/hackernews-scraper

Scrape Hacker News via the official Firebase API + Algolia search. Top/new/best/ask/show/jobs stories, full comment trees, user profiles with karma, free-text search. No browser, no proxies, no auth. Pay only per result item.

Perconey

Stackoverflow Scraper

openclawmara/stackoverflow-scraper

Scrape Stack Overflow questions, answers, tags, and user profiles. Search by keyword, tag, or date range. Extract vote counts, accepted answers, code snippets, and discussion threads. Ideal for developer knowledge mining and technical research.

OpenClaw Mara

TechCrunch Scraper

automation-lab/techcrunch-scraper

Scrape TechCrunch articles. Search by keyword or browse latest posts. Get titles, authors, categories, excerpts, and publication dates. Export to JSON, CSV, or Excel.

Stas Persiianenko

HN Top Stories Scraper

cryptosignals/hn-top-stories

Scrape Hacker News top stories — extract title, URL, score, author, comment count, and submission time. Monitor HN front page in real time. CSV/JSON.

Web Data Labs

Hacker News Search — Stories, Comments & Developer Sentiment

ryanclinton/hackernews-search

Search and extract stories, comments, polls, Show HN, and Ask HN posts from Hacker News. This actor uses the Algolia HN Search API to find content by keyword, filter by author, date range, minimum points, and comment count -- then returns clean, structured JSON ready for analysis, monitoring, or ...