Pricing

from $1.50 / 1,000 results

Hacker News Historical Archive Scraper — Old Stories by Date

Bulk-export the entire Hacker News archive between any two dates in chronological order. Stories, comments, Ask/Show HN, polls and jobs since 2006 via the keyless Algolia HN API. Time-windowed firehose yields hundreds of thousands of rows. No API key, no login.

Pricing

from $1.50 / 1,000 results

Rating

0.0

(0)

Developer

Logiover

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Categories

News

Developer tools

Content Type

contentType

Optional

Which kind of Hacker News item to export. 'Stories' = link + text posts (the classic front-page firehose). 'Comments' = every comment body with its parent/story. 'Show HN' / 'Ask HN' = those two dedicated categories. 'Polls', 'Jobs' = those item types. 'All' = stories + comments + polls + jobs combined in one chronological stream.

Type:string

Default:story

Options:

storycommentshow_hnask_hnpolljobfront_pageall

Start Date (inclusive, UTC)

startDate

Required

The oldest date to include, as YYYY-MM-DD (UTC). Everything created on or after this date is exported. HN launched in 2006, so any date from 2006-10-01 onward is reachable. Example: '2024-01-01'.

Type:string

End Date (inclusive, UTC)

endDate

Required

The newest date to include, as YYYY-MM-DD (UTC). Everything created on or before the END of this day is exported. Combine with Start Date to define your window. Example: '2024-01-08'.

Type:string

Keyword filter (optional)

query

Optional

OPTIONAL keyword to narrow the export (matched against titles, text and comment bodies). Leave EMPTY for a pure firehose that returns every item in the date window. Use this only if you want a topic slice, e.g. 'openai', 'rust', 'layoffs'.

Type:string

Default:

Authors (optional)

authors

Optional

OPTIONAL list of Hacker News usernames to restrict the export to (no @ prefix). Each username is queried separately across the date window. Leave empty to include all authors. Example: ['pg', 'dang', 'patio11'].

Type:array

Default:

[]

Minimum Points

minPoints

Optional

Only include items with at least this many points (upvotes). 0 = no filter. Useful to pull only high-engagement stories. Note: comments and jobs do not carry points, so a non-zero value effectively limits results to stories/polls.

Type:integer

Minimum:0

Default:0

Minimum Comments

minComments

Optional

Only include items with at least this many comments. 0 = no filter. Applies to stories/Ask/Show/polls (comments themselves have no comment count).

Type:integer

Minimum:0

Default:0

Max Items

maxItems

Optional

Global hard cap on rows returned by the run. Default 5000 is a sane starting point; raise it (e.g. 100000+) to pull a full multi-year corpus. 0 = unlimited (bounded only by the date window and the run timeout).

Type:integer

Minimum:0

Default:5000

Proxy

proxyConfiguration

Optional

Apify Proxy configuration. The Algolia HN Search API is a fast public CDN endpoint that works over a direct connection, so datacenter proxy (the default) is plenty and keeps cost low. A fresh proxy session is minted per retry to rotate away from any throttled IP.

Type:object

Default:

{
  "useApifyProxy": true
}

Internet Archive Metadata Scraper — Bulk archive.org Export

logiover/internet-archive-metadata-scraper

Bulk-export item metadata from the Internet Archive (archive.org) by full-text query, collection, media type, creator, subject and date range. Extract identifier, title, creator, date, downloads, format, subject and more. Millions of items. No API key, no login.

Logiover

Reddit Search Scraper — Posts, Comments & Users

logiover/reddit-search-scraper

Scrape Reddit subreddit search with no API key or login. Export posts and comments to CSV/JSON — a Reddit API alternative for keyword monitoring.

Logiover

Reddit Historical Archive Scraper - Old Posts by Date

logiover/reddit-historical-archive-scraper

Pushshift alternative to scrape old Reddit posts and comments without an API key. Full-text comment search, user history, export to CSV/JSON.

Logiover

🗄️ Reddit Archive Scraper - Years of Posts & Comments

benthepythondev/reddit-archive-scraper

Reddit Archive Scraper to extract years of historical Reddit posts and comments from the PullPush archive. Reddit's API caps subreddits at ~1000 posts; this Actor pulls months or years from many subreddits by date range and keyword. For historical backfill, research and AI datasets.

Ben

Hacker News Scraper - Stories, Comments & Search

legend006/hackernews-scraper

Scrape Hacker News stories, comments, polls, jobs, and Ask/Show HN posts. Search by keyword and date range, pull a user's full activity, or fetch any HN list (front page, new, best, ask, show, job). No auth required. Built for AI/ML datasets, tech trend research, and news monitoring.

NIJ KANANI

Hacker News Search — Stories, Comments & Developer Sentiment

ryanclinton/hackernews-search

Search and extract stories, comments, polls, Show HN, and Ask HN posts from Hacker News. This actor uses the Algolia HN Search API to find content by keyword, filter by author, date range, minimum points, and comment count -- then returns clean, structured JSON ready for analysis, monitoring, or ...

Ryan Clinton

Hacker News API Scraper - Stories, Comments & Polls

logiover/hacker-news-search-scraper

Hacker News scraper & HN API alternative. Scrape stories, comments, Ask HN & Show HN without login; export to CSV/JSON. No key, no proxy.

Logiover

HackerNews Insights Scraper — Stories, Comments & Velocity

brilliant_gum/hackernews-insights-scraper

Hacker News stories, full comment trees, user karma and contact info, story velocity tracking, history deltas. Search all 3.7M stories with filters for points, karma, domain, dates, keywords. For VCs hunting Show HN, recruiters mining talent, journalists tracking tech, and AI/RAG pipelines.

Yuliia Kulakova

Hacker News Scraper: Stories, Comments, Users & Search

nominated_tupelo/hacker-news-scraper

Scrape Hacker News stories, comments, user profiles, and search by keyword using the official HN Firebase API and Algolia search API. No auth required.

kade

HackerNews Monitor + Auto-Tagger | Free Preview

w4rd0g/hackernews-monitor

Search and monitor HackerNews stories, Show HN, Ask HN, polls, jobs by keyword and date range. Auto-tag every post with your custom keyword list. For trend detection, market intel, AI launch monitoring. FREE during launch preview.