7 days trial then $40.00/month - No credit card required now
Capterra Scraper
7 days trial then $40.00/month - No credit card required now
Extract valuable data from the Capterra software database with our Capterra Scraper. Gather product information, related products, insights, portfolio, real client reviews, and more. Explore top software listings for your business.
Does not paginate
Closed
Hey,
I thought it would paginate automatically but it does not. Here is my 2nd try where I set endPage to a high number. Docs says when it's empty it would scrape all, but also then it's only 25 results. Am I doing sth wrong?
1{ 2 "customMapFunction": "(object) => { return {...object} }", 3 "endPage": 50, 4 "endPageForReviews": 1, 5 "includeReviews": false, 6 "maxItems": 500, 7 "proxy": { 8 "useApifyProxy": true, 9 "apifyProxyGroups": [ 10 "RESIDENTIAL" 11 ] 12 }, 13 "reviewsOnly": false, 14 "startUrls": [ 15 "https://www.capterra.com/help-desk-software/?platform=%5B1%5D" 16 ] 17}
tugkan_epctex
Hey Mathias Nestler!
You are absolutely right. It seems like we were not paginating on the listing pages at all. Sorry for this nasty bug and the inconvenience. We've fixed the problem and deployed the latest source code into the Apify Platform.
Please let us know if you need any further assistance. Best
epctex
