Pricing

$45.00/month + usage

Go to Store

Reddit Scraper

Try for free

Developed by

Gustavo Rudiger

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

3.9 (2)

Pricing

$45.00/month + usage

115

Total users

6.9K

Monthly users

441

Runs succeeded

>99%

Issues response

2.2 days

Last modified

an hour ago

Social media

Back to issues Create new issue

Fails on communities

Closed

jonbarrow opened this issue

Seems to fail when scraping a community. Using default settings. The Lite version does not have this issue. Log:

2025-05-05T03:37:46.113Z ACTOR: Pulling Docker image of build S4UiFDwYiCKgmZtw2 from registry.
2025-05-05T03:37:46.201Z ACTOR: Creating Docker container.
2025-05-05T03:37:46.452Z ACTOR: Starting Docker container.
2025-05-05T03:37:48.482Z INFO  System info {"apifyVersion":"3.4.0","apifyClientVersion":"2.12.3","crawleeVersion":"3.13.2","osType":"Linux","nodeVersion":"v20.19.1"}
2025-05-05T03:37:48.667Z INFO  Found startUrl. Search params will be ignored.
2025-05-05T03:37:49.366Z INFO  Starting the crawl.
2025-05-05T03:37:49.517Z INFO  PuppeteerCrawler: Starting the crawler.
2025-05-05T03:37:52.830Z INFO  Processing https://www.reddit.com/r/worldnews/?include_over_18=on ...
2025-05-05T03:37:56.879Z WARN  PuppeteerCrawler: Reclaiming failed request back to the list or queue. SyntaxError: Unexpected token '<', "<body clas"... is not valid JSON
2025-05-05T03:37:56.881Z     at JSON.parse (<anonymous>)
2025-05-05T03:37:56.883Z     at getURLDataAsJSON (file:///home/myuser/src/tools.js:577:15)
2025-05-05T03:37:56.885Z     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
2025-05-05T03:37:56.887Z     at async Promise.all (index 1)
2025-05-05T03:37:56.898Z     at async communityJSONParser (file:///home/myuser/src/parsers/communityJSONParser.js:20:35)
2025-05-05T03:37:56.903Z     at async handleCommunityInfo (file:///home/myuser/src/routes.js:28:21)
2025-05-05T03:37:56.905Z     at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21) {"id":"7htqwWEFkKdWZ4s","url":"https://www.reddit.com/r/worldnews/.json?include_over_18=on","retryCount":1}
2025-05-05T03:37:58.726Z INFO  Processing https://www.reddit.com/r/worldnews/?include_over_18=on ...
2025-05-05T03:38:04.491Z WARN  PuppeteerCrawler: Reclaiming failed request back to the list or queue. SyntaxError: Unexpected token '<', "<body clas"... is not valid JSON
2025-05-05T03:38:04.498Z     at JSON.parse (<anonymous>)
2025-05-05T03:38:04.500Z     at getURLDataAsJSON (file:///home/myuser/src/tools.js:577:15)
2025-05-05T03:38:04.503Z     at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
2025-05-05T03:38:04.505Z     at async Promise.all (index 0)
2025-05-05T03:38:04.506Z     at async communityJSONParser (file:///home/myuser/src/parsers/communityJSONParser.js:20:35)
2025-05-05T03:38:04.508Z     at async handleCommunityInfo (file:///home/myuser/src/routes.js:28:21)
2025-05-05T03:38:04.511Z     at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21) {"id":"7htqwWEFkKdWZ4s","url":"https://www.reddit.com/r/worldnews/.json?include_over_18=on","retryCount":2}
2025-05-05T03:38:05.845Z INFO  Processing https://www.reddit.com/r/worldnews/?include_over_18=on ...
2025-05-05T03:38:33.189Z ACTOR: The Actor run was aborted by the user.

Gustavo Rudiger (trudax)

Is the issue still happening for you? I was able to scrape using the same input as your run.

Add comment

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

6.9K

3.9

Reddit Posts Scraper

vulnv/reddit-posts-scraper

Unlimited Reddit web scraper to crawl posts, comments and subreddits without login.

VulnV

5.0

(New) Reddit Scraper Pro - Fast, Affordable, Supported

harshmaur/reddit-scraper-pro

Reddit Scraper Pro is a powerful, user-friendly tool for extracting data from Reddit without API limitations. Offers scraping of posts, users, comments, and communities, advanced search capabilities, and multiple export options. Perfect for brand monitoring, trend tracking, and competitor research.

Harsh Maur

336

5.0

Reddit scraper

curious_coder/reddit-scraper

Scrape reddit posts and comments from reddit search and communities

Curious Coder

242

Reddit API Scraper

comchat/reddit-api-scraper

Reddit Scraper is a powerful tool that allows you to extract data from Reddit such as posts by keyword. With Reddit Scraper, you can easily gather valuable information from Reddit without the need to log in. You can easily use this Reddit scraper as an alternative API.

Comchat

876

1.0

Reddit Scraper

epctex/reddit-scraper

Tap into the wealth of Reddit's data with our Reddit Scraper. Extract valuable insights from posts, subreddits, comments, and user data effortlessly. Simplify analysis and gain valuable insights from the diverse Reddit community with our user-friendly and efficient tool.

epctex

862

Reddit Scraper For Posts & Comments

creative_tablecloth/reddit-scraper-for-posts

Access Reddit data freely without authentication. Quickly extract detailed information from Reddit posts and comments, both efficiently and cost-effectively. (approx $0.015 for 1,000 results)

Jinny Kim

211

Reddit Posts Search Scraper

easyapi/reddit-posts-search-scraper

Extract Reddit posts from search results with rich metadata, including media content, engagement metrics, and community information. Perfect for content research, trend analysis, and social media monitoring across Reddit communities.

EasyApi

5.0

Reddit Explorer 3.0

jupri/reddit

💫 Scrape Reddit.com ⬛🟪🟦🟩🟨🟧🟥🟫

cat

194

Reddit Comments Scraper

easyapi/reddit-comments-scraper

Extract Reddit comments with their complete thread structure, including nested replies, user information, and engagement metrics. Perfect for analyzing discussions, sentiment analysis, and tracking community engagement on Reddit posts.

EasyApi