This changelog highlights releases that materially changed Reddit Scraper for users. Dates use UTC; small internal refactors and routine maintenance are intentionally omitted.
Reliability
- Works without Reddit RSS; retrieves real vote scores and comment counts from public web pages.
- Follows fuller listing pagination and fixes r/all discovery.
- Preserves existing input options, output fields and prices.
- Standby retries transient upstream failures up to three times and returns retryable HTTP 502 for exhausted target failures; genuinely empty results retain HTTP 404.
Reliability
- Require unstyled, explicitly supported fallback empty-result markers and ancestor paths; hidden or uncertain styled messages no longer erase upstream errors. Useful posts and independently supported empty messages are retained.
- Reject structurally malformed feeds and blank or unrecognized fallback pages instead of reporting false empty results; retain explicit empty results and useful fallback posts.
- Reuse one lazy browser process across comment-recovery posts, with fresh isolated post sessions and bounded crash recovery; close it when the request finishes or is cancelled.
- Keep RSS requests direct-first and use residential recovery for actual blocking, not blank or malformed feeds or missing resources.
- Finish recognized empty feeds without paid fallback, comment-tree startup or unnecessary waits; continue reporting upstream errors and unverified comment coverage honestly.
Reliability
- Avoid extra public comment-tree requests when the feed already provides enough distinct comments within the requested depth and output limit; retain expansion for below-limit feeds and unverified-coverage warnings.
- Stop replaying RSS pagination cursors that Reddit has already returned, preserving available distinct results without repeated identical page requests.
- Skip redundant retries for invalid or missing resources while retaining alternative-source recovery, transient-error retries and truthful target failures.
Fixes / Reliability
- Recover additional nested comment bodies through bounded public tree and subthread expansion, using an anonymous session bootstrap when needed.
- Preserve genuine reply depth and parents; unknown nesting is marked explicitly rather than clamped or labeled top-level.
- Separate source-reported comment totals from extracted comments and warn when complete coverage cannot be verified.
Fixes / Safety
- Reddit Share links now resolve to their intended post rather than silently scraping the subreddit. Resolution uses bounded header-only requests; blocked or unsafe redirects return a clear error with canonical post URL guidance.
- Batch and Standby requests keep Share resolution caches isolated; existing post/comment output and prices are unchanged.
Safety / Integrations
- Connector summaries now require an explicit supported messaging tool and destination; unknown, destructive, unannotated or incompatible operations are refused without calls.
- Fixed MCP error responses being reported as successful delivery. Export outcomes are categorical and leave full dataset output and billing unchanged.
- Prefer the documented connector runtime variable with a legacy fallback; summaries are capped at 8192 UTF-8 bytes and destination values are redacted from diagnostics.
Reliability
- Reduced memory pressure when processing large subreddit/search responses and multi-target batches, without reducing output fields or limits.
- Fixed valid RSS posts and comments mentioning rate limits being mistaken for blocked responses.
Reliability
- Fatal batch errors now preserve failed-run status instead of passing through normal-success cleanup. Scraping output and charging remain unchanged.
Features
- Added opt-in Standby HTTP endpoints for short subreddit and post/comment requests. Batch runs, dataset output, and existing per-event prices remain unchanged.
Reliability
- Large multi-target and comment-heavy runs now retain only a bounded in-memory export sample while streaming the complete dataset, reducing the risk of memory-related failures without changing output.
Reliability
- Runs with a custom short platform timeout now stop before the deadline and preserve already scraped posts instead of being terminated while processing later targets.
Fixes
- Fixed AI-ready output so
jsonl-finetune assistant messages and rag-markdown documents include available comment text and author metadata in the transformed post record. These formats no longer emit or charge separate comment records.
Fixes
- Fixed
sort and timeFilter inputs being ignored for plain subreddit URLs. Subreddit runs now honor the requested ranking and time period unless the URL explicitly specifies its own sort or time filter.
Reliability
- Restored bounded best-effort post score, upvote-ratio, and comment-score enrichment when Reddit blocks direct public-page requests. The Actor now retries only the optional enrichment request through a US residential proxy while keeping RSS discovery direct and preserving valid RSS output if enrichment remains unavailable.
- Direct post URLs now also attempt vote enrichment from Reddit's public post/comment markup; fields remain best-effort when Reddit does not expose them.
Fixes
- Improved runs when Reddit blocks or rate-limits its RSS pages. The Actor now reaches its alternative public-data fallback sooner instead of exhausting unnecessary retries.
- Reduced the time and recovery overhead for blocked subreddit and search targets while preserving the existing output format.
Reliability
- Blocked RSS responses are no longer reported as successful runs with an unexplained empty dataset.
- Empty, private, unavailable, and invalid targets now produce a clear target-status dataset record when possible, so automations can distinguish "no accessible results" from an Actor failure.
- Improved non-RSS recovery for subreddit listings and Reddit searches.
Features
- Post records now include the discovered Reddit comment count when comments are scraped.
- Added optional delivery of a bounded run summary to an Apify MCP connector. This is opt-in through the
mcpDestinationConnector input and does not replace the normal dataset output.
Integrations
- MCP clients and AI assistants can now pass a single Reddit URL through
url, comment_url, or commentUrl; the Actor normalizes these aliases to the standard urls input.
Features
- Added focused comment-context mode for a specific Reddit comment URL. It returns the target comment and the surrounding context Reddit makes publicly available.
Changes
- Reworked Reddit recovery around public RSS and fallback pages, restoring practical coverage for listings, searches, users, posts, and comments after Reddit restricted older access paths.
- Removed internal recovery metadata from public dataset records. Some vote, award, subscriber, media, and deep-comment fields remain best-effort when Reddit does not expose them publicly.
Reliability
- Expanded fallback coverage across subreddit listings, searches, user profiles, direct posts, and nested comments when Reddit limits its primary public pages.
Features
- Added convenient subreddit and user shortcuts, finer comment controls, and AI-ready
jsonl-finetune and rag-markdown output formats.
Safety
- The Actor now respects Apify's maximum charge per run and stops cleanly when the configured spending cap is reached.
Fixes
- Fixed request compatibility regressions that caused affected runs to finish with zero Reddit items. Users affected by empty results could rerun the same input after this release.
Features
- Added
jsonl-finetune output for supervised fine-tuning datasets and rag-markdown output for retrieval and LLM workflows.
Features
- Added strict keyword filtering and duplicate removal for Reddit posts.
Fixes
- Improved handling of nullable Reddit fields and fixed a missing cloud runtime dependency.