1 day trial then $45.00/month - No credit card required now

Reddit Scraper

trudax/reddit-scraper

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Back to issues Create new issue

Irrelevant data despite using keyword search

Closed

highbrow_desert opened this issue

Run Id: "g0U8gX5voivV1y39v"

I wanted to scrape reddit data from the sub-reddit "r/birthcontrol" using 58 keywords. However, when I went through the outputs, I observed the following:

The sub-reddit has more than 250K post + comments in the past 2.5 years but I am getting only 5.8K
Even in the 5.8K post + comments, many of it did not contain the keywords that I had provided

Could you provide a solution for the same.

Also, had few additional questions

Is there a possibility to scrape data for a particular time period i.e. last 3 years data
What do I have to do if I want to scrape all the data available for a particular sub-reddit
Is there a data limit per keyword?
Is there a data limit per sub-reddit?

Gustavo Rudiger (trudax)

When you use a startUrl the search parameters are ignored. I like what you are trying to do, I will update the actor to allow you to search using a startUrl as base. The navigation on Reddit does not allow you to filter by date so the only option is to scrape all that you can and filter it out after. Reddit also limits the number of posts you can get so it is difficult to scrape all data for a subreddit because even if you go page by page Reddit will not show you all of it.

Add comment

Developer

Gustavo Rudiger

Actor Metrics

324 monthly users
58 stars
>99% runs succeeded
1.3 days response time
Created in Feb 2022
Modified 11 days ago

Categories

Social media

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

3.8k

(New) Reddit Scraper Pro - Fast, Affordable, Supported

harshmaur/reddit-scraper-pro

Reddit Scraper Pro is a powerful, user-friendly tool for extracting data from Reddit without API limitations. Offers scraping of posts, users, comments, and communities, advanced search capabilities, and multiple export options. Perfect for brand monitoring, trend tracking, and competitor research.

Harsh Maur

Reddit Scraper For Posts & Comments

creative_tablecloth/reddit-scraper-for-posts

Access Reddit data freely without authentication. Quickly extract detailed information from Reddit posts and comments, both efficiently and cost-effectively. (approx $0.015 for 1,000 results)

Jinny Kim

Reddit API Scraper

comchat/reddit-api-scraper

Reddit Scraper is a powerful tool that allows you to extract data from Reddit such as posts by keyword. With Reddit Scraper, you can easily gather valuable information from Reddit without the need to log in. You can easily use this Reddit scraper as an alternative API.

Comchat

486

Reddit Email Scraper

bhansalisoft/reddit-email-scraper

Reddit Email Scraper- Scrap Emails from Reddit specific profile using google search engine

bhansalisoft

Ultimate Reddit Profile Scraper (Lite)

potatopeeler/reddit-account-scraper-lite

Pay per result. Seamlessly download full Reddit user accounts, capturing posts, images, activity, and historical data, including URLs and media comments. Export detailed insights to CSV, JSON, XML, EXCEL formats, or effortlessly import them into your email for comprehensive analysis and easy access.

Jamie Potato

Reddit Ads Scraper

lexis-solutions/reddit-ads-scraper

Find and scrape top ads on Reddit. Get ad copy, ad shown date, ad type, industry, budget, and more. Download and track data from the Reddit Ads for competitive analysis.

Lexis Solutions

Google Maps Extractor

compass/google-maps-extractor

Extract data from hundreds of places fast. Scrape Google Maps by keyword, category, location, URLs & other filters. Get addresses, contact info, opening hours, popular times, prices, menus & more. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Compass

18k

355

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

59.3k

506

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

15k

191