1 day trial then $45.00/month - No credit card required now

Reddit Scraper

trudax/reddit-scraper

1 day trial then $45.00/month - No credit card required now

Unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Back to issues Create new issue

Getting multiple duplicates for the same comment

Closed

ons_kharrat opened this issue

I have scraped 20k items which are mostly comments. When performing data cleaning, I have noticed that only 1k of these items are unique and the other 19K are just multiple duplicates of the same unique items. Some comment appeared more than 100 times! How can I avoid this issue?

Gustavo Rudiger (trudax)

Can you share your run ID so I can take a look at what is happening?

ons_kharrat

Hey! My run id is V9An8uU7tUqWgw58R I have also run the actor again to get more data, will let you know if I face any issues with the new data.

ons_kharrat

Hey, I have faced another issue with my new scraping, it is scraping comments, but not scraping the posts these comments belong to. Is there a way to avoid this?

Gustavo Rudiger (trudax)

I have fixed the duplication issue.

Add comment

Developer

Gustavo Rudiger

Actor Metrics

360 monthly users
82 bookmarks
>99% runs succeeded
4.4 days response time
Created in Feb 2022
Modified 2 days ago

Categories

Social media

Reddit Scraper Lite

trudax/reddit-scraper-lite

Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.

Gustavo Rudiger

4.7k

(New) Reddit Scraper Pro - Fast, Affordable, Supported

harshmaur/reddit-scraper-pro

Reddit Scraper Pro is a powerful, user-friendly tool for extracting data from Reddit without API limitations. Offers scraping of posts, users, comments, and communities, advanced search capabilities, and multiple export options. Perfect for brand monitoring, trend tracking, and competitor research.

Harsh Maur

143

Reddit Scraper For Posts & Comments

creative_tablecloth/reddit-scraper-for-posts

Access Reddit data freely without authentication. Quickly extract detailed information from Reddit posts and comments, both efficiently and cost-effectively. (approx $0.015 for 1,000 results)

Jinny Kim

139

Reddit API Scraper

comchat/reddit-api-scraper

Reddit Scraper is a powerful tool that allows you to extract data from Reddit such as posts by keyword. With Reddit Scraper, you can easily gather valuable information from Reddit without the need to log in. You can easily use this Reddit scraper as an alternative API.

Comchat

626

Reddit Comments Scraper

easyapi/reddit-comments-scraper

Extract Reddit comments with their complete thread structure, including nested replies, user information, and engagement metrics. Perfect for analyzing discussions, sentiment analysis, and tracking community engagement on Reddit posts.

EasyApi

Instagram Scraper

apify/instagram-scraper

Scrape and download Instagram posts, profiles, places, hashtags, photos, and comments. Get data from Instagram using one or more Instagram URLs or search queries. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

74.5k

TikTok Data Extractor

clockworks/free-tiktok-scraper

Extract data about videos, users, and channels based on hashtags or scrape full user profiles including posts, total likes, name, nickname, numbers of comments, shares, followers, following, and more.

Clockworks

21.4k

377

Facebook Posts Scraper

apify/facebook-posts-scraper

Extract data from hundreds of Facebook posts from one or multiple Facebook pages and profiles. Get post URL, post text, page or profile URL, timestamp, number of likes, shares, comments, and more. Download the data in JSON, CSV, and Excel and use it in apps, spreadsheets, and reports.

Apify

18.3k

286

Export Instagram Comments and Posts

apify/export-instagram-comments-posts

This unique tool allows you to scrape Instagram posts and its comments in one run. Export scraped data, run the scraper via API, schedule and monitor runs, or integrate with other tools.

Apify

609

Instagram Post Scraper

apify/instagram-post-scraper

Scrape Instagram posts. Just add one or more Instagram usernames and get your data in seconds including text, hashtags, mentions, comments, images, URLs, likes, locations, and metadata. Export scraped data, run the scraper via API, schedule and monitor runs or integrate with other tools.

Apify

26k

272