Google Play Data Extractor avatar
Google Play Data Extractor
Try for free

3 days trial then $35.00/month - No credit card required now

View all Actors
Google Play Data Extractor

Google Play Data Extractor

epctex/google-play-scraper
Try for free

3 days trial then $35.00/month - No credit card required now

Get valuable info & reviews from Google Play! Access title, price, ratings, download rates, screenshots, released date, version number & developer details for any region or language. Unlimited & lightning-fast extraction. Export data in XML, JSON, CSV, Excel, or HTML formats.

User avatar

Scrapper failed what large data set

Closed

eclipse-ai opened this issue
6 months ago

With following input { "endReviewsPage": 100, "includeReviews": true, "proxy": { "useApifyProxy": true }, "startUrls": [ "https://play.google.com/store/apps/details?id=com.scopely.monopolygo" ], "onlyIncludeReviews": false } after 94 pages, it starts returning request too large error. Please see attached screen shot

2nd issue is, despite of failure, it called success webhook with empty data. Please see screenshot for storage json.

User avatar

epctex (epctex)

5 months ago

Hey there,

Thank you very much for using the actor and letting us know about your problem. We've investigated deeply and found out that the data you are trying to retrieve is too large for Apify's limitations. Apify has a limitation per each output object and it cannot be exceeded by anyone.

As far as I can see, you are trying to retrieve as many reviews as possible without having any issues. To achieve such a goal, I would strongly suggest you use the "includeReviews" and "onlyIncludeReviews" options both set to true. In this way, you won't retrieve the information for the application but retrieve as many reviews as possible. Each of the output objects will be a single review and you will bypass these limitations of Apify.

Please let me know if there is anything that I can assist you with. Closing the issue now, but feel free to reply back if you have any questions or concerns. We are always here to help you. Best

Developer
Maintained by Community
Actor metrics
  • 27 monthly users
  • 97.5% runs succeeded
  • 0.3 days response time
  • Created in May 2020
  • Modified about 8 hours ago