Reddit Scraper Lite
Pricing
Pay per event
Reddit Scraper Lite
Pay Per Result, unlimited Reddit web scraper to crawl posts, comments, communities, and users without login. Limit web scraping by number of posts or items and extract all data in a dataset in multiple formats.
3.9 (3)
Pricing
Pay per event
207
Total users
7.8K
Monthly users
1K
Runs succeeded
91%
Issues response
3.8 days
Last modified
7 days ago
Lot of failures occuring
Open
Been trying this out and have noticed that a large number (~50%) of crawls are failing. Is there a reason for this?
Update: going back through it seems like it's occurring mostly with async requests vs batch requests. Not sure if that makes it an actor or apify issue but when it fails it's because it's getting a 403
Can you share your run ID so I can take a look at what is happening?
autostrat
Yeah, here are a few of them. zANFMARDNPc8Owv44, mgvTaf4gyVAqBapHk, nuUwtglv7UhOTc9zE, 0sLHfFbln8ZTSdzyJ
Seems like it's more an issue if I send it as an async vs sending them all as a single request. Was attempting async to help prevent the cleanup needed when batching them together as a single request
Unfortunately looks like Reddit blocked those requests. I have updated the actor with the latest changes from Apify, which should help reduce the amount of bot detection. Let me know if you still see a lot of failures.
