1 day trial then $45.00/month - No credit card required now

Reddit Scraper

trudax/reddit-scraper

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Back to issues Create new issue

Crawling data are not enough.

Closed

junior_fist opened this issue

I only collected 3000 posts and comments even though I didn't set the limit. I wonder if I could collect more data than 3000.

Gustavo Rudiger (trudax)

can you share the run ID so I can look at what is happening?

junior_fist

https://console.apify.com/view/runs/IDYivXgybpMP9K7OD

This is the latest one that I collected. Thank you for your help.

junior_fist

I also wonder why I only collected data for a few days even though I set the time for all time.

Gustavo Rudiger (trudax)

Reddit only provides the last 1000 posts and your run went to that last page available on the website. According to the logs, this was the last page: https://www.reddit.com/r/doordash_drivers/?after=t3_18d6lbg. You are also limiting to 3 comments per each post which results in the ~3000 results you are getting.

junior_fist

Is there any way for me to get more than the last 1000 posts?

Gustavo Rudiger (trudax)

Not that I know of. It is a hard limit imposed by Reddit for many years now.

Add comment

Developer

Gustavo Rudiger

Actor metrics

274 monthly users
23 stars
100.0% runs succeeded
23 hours response time
Created in Feb 2022
Modified 16 days ago

Categories

Social media

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

3.2k

Reddit Scraper For Posts & Comments

creative_tablecloth/reddit-scraper-for-posts

Access Reddit data freely without authentication. Quickly extract detailed information from Reddit posts and comments, both efficiently and cost-effectively. (approx $0.015 for 1,000 results)

Jinny Kim

Reddit API Scraper

comchat/reddit-api-scraper

Reddit Scraper is a powerful tool that allows you to extract data from Reddit such as posts by keyword. With Reddit Scraper, you can easily gather valuable information from Reddit without the need to log in. You can easily use this Reddit scraper as an alternative API.

Comchat

332

Similarweb Scraper

seadapp/similarweb-scraper

Less than $3/K results, Gets you Sites data from Similarweb. Unofficial API. Download your data as JSON, HTML Table, CSV, Execl, RSS Feed and JSONL

Seadapp

Ultimate Reddit Profile Scraper (Lite)

potatopeeler/reddit-account-scraper-lite

Pay per result. Seamlessly download full Reddit user accounts, capturing posts, images, activity, and historical data, including URLs and media comments. Export detailed insights to CSV, JSON, XML, EXCEL formats, or effortlessly import them into your email for comprehensive analysis and easy access.