1 day trial then $45.00/month - No credit card required now

Reddit Scraper

trudax/reddit-scraper

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Back to issues Create new issue

Getting multiple duplicates for the same comment

Closed

ons_kharrat opened this issue

I have scraped 20k items which are mostly comments. When performing data cleaning, I have noticed that only 1k of these items are unique and the other 19K are just multiple duplicates of the same unique items. Some comment appeared more than 100 times! How can I avoid this issue?

Gustavo Rudiger (trudax)

Can you share your run ID so I can take a look at what is happening?

ons_kharrat

Hey! My run id is V9An8uU7tUqWgw58R I have also run the actor again to get more data, will let you know if I face any issues with the new data.

ons_kharrat

Hey, I have faced another issue with my new scraping, it is scraping comments, but not scraping the posts these comments belong to. Is there a way to avoid this?

Gustavo Rudiger (trudax)

I have fixed the duplication issue.

Add comment

Developer

Gustavo Rudiger

Actor Metrics

324 monthly users
58 stars
>99% runs succeeded
1.8 days response time
Created in Feb 2022
Modified 9 days ago

Categories

Social media

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

3.8k

(New) Reddit Scraper Pro - Fast, Affordable, Supported

harshmaur/reddit-scraper-pro

Reddit Scraper Pro is a powerful, user-friendly tool for extracting data from Reddit without API limitations. Offers scraping of posts, users, comments, and communities, advanced search capabilities, and multiple export options. Perfect for brand monitoring, trend tracking, and competitor research.

Harsh Maur

Reddit Scraper For Posts & Comments

creative_tablecloth/reddit-scraper-for-posts

Access Reddit data freely without authentication. Quickly extract detailed information from Reddit posts and comments, both efficiently and cost-effectively. (approx $0.015 for 1,000 results)

Jinny Kim

Reddit API Scraper

comchat/reddit-api-scraper

Reddit Scraper is a powerful tool that allows you to extract data from Reddit such as posts by keyword. With Reddit Scraper, you can easily gather valuable information from Reddit without the need to log in. You can easily use this Reddit scraper as an alternative API.

Comchat

482

Ultimate Reddit Profile Scraper (Lite)

potatopeeler/reddit-account-scraper-lite

Pay per result. Seamlessly download full Reddit user accounts, capturing posts, images, activity, and historical data, including URLs and media comments. Export detailed insights to CSV, JSON, XML, EXCEL formats, or effortlessly import them into your email for comprehensive analysis and easy access.

Jamie Potato

SubReddit Posts Search Scraper

easyapi/subreddit-posts-search-scraper

Scrape Reddit search results from any subreddit with advanced filtering options. Extract post titles, URLs, votes, comments, timestamps and more. Perfect for market research, content analysis and trend monitoring.

EasyApi

SubReddit Media Search Scraper

easyapi/subreddit-media-search-scraper

Extract media content (images and videos) from Reddit subreddit search results with advanced filtering options. Perfect for content analysis, trend monitoring, and media collection from specific communities.

EasyApi

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

59k

502

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

14.9k

189

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.