Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Back to issues Create new issue

Length of Historical data by Subreddit

Closed

arham.choudhury opened this issue

Hello, I did three runs of Reddit Scraper Lite on 2024-12-17 from 3 different subreddits. I got varying lengths of historical data from each run. I am trying to understand why the history data is different.

r/AppleArcade: I was able to access about 6 months of posts and comments r/iosgaming: I only see past 2 weeks of posts and comments r/Gaming: I only see 1 days worth of posts and comments.

Why is the length of history data different? Do the rate limits differ by subreddit? Thanks

Gustavo Rudiger (trudax)

The scraper can only get what is available on the website. Reddit has a policy of keeping around 1000 posts for each subreddit. You should be seeing around that number of posts.

Add comment

Developer

Gustavo Rudiger

Actor Metrics

436 monthly users
92 bookmarks
92% runs succeeded
22 hours response time
Created in Jun 2020
Modified 3 days ago

Categories

Ultimate Reddit Profile Scraper (Lite)

potatopeeler/reddit-account-scraper-lite

Pay per result. Seamlessly download full Reddit user accounts, capturing posts, images, activity, and historical data, including URLs and media comments. Export detailed insights to CSV, JSON, XML, EXCEL formats, or effortlessly import them into your email for comprehensive analysis and easy access.

Jamie Potato

Reddit Post Scraper

pratikdani/reddit-post-scraper

A Reddit post scraper, fetching data like titles, authors, content, and scores from specified subreddits or search queries. Delivers valuable insights from the Reddit hivemind for analysis and trend identification.

Pratik Dani

Mass Reddit Email Scraper

perfectscrape/Reddit-email-scraper

Extract emails from Reddit fast and effortlessly! Search by keywords, location, scrape unlimited amount of emails, and set filters for domains like Gmail, Yahoo, or custom options. Get precise email lists with Reddit source links. Get emails from comments, profile and posts. Try it today! 🚀

Sadnan

YouTube Scraper

streamers/youtube-scraper

YouTube crawler and video scraper. Alternative YouTube API with no limits or quotas. Extract and download channel name, likes, number of views, and number of subscribers.

Streamers

13.6k

458

Reddit Scraper

trudax/reddit-scraper

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

5.7k

Website Content Crawler

apify/website-content-crawler

Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.

Apify

36.8k

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

74.5k

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

21.4k

377

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

18.3k

286

Export Instagram Comments and Posts

apify/export-instagram-comments-posts

This unique tool allows you to scrape Instagram posts and its comments in one run. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

609