Capterra Scraper
7 days trial then $40.00/month - No credit card required now
Capterra Scraper
7 days trial then $40.00/month - No credit card required now
Extract valuable data from the Capterra software database with our Capterra Scraper. Gather product information, related products, insights, portfolio, real client reviews, and more. Explore top software listings for your business.
Hey,
I thought it would paginate automatically but it does not. Here is my 2nd try where I set endPage
to a high number. Docs says when it's empty it would scrape all, but also then it's only 25 results. Am I doing sth wrong?
1{ 2 "customMapFunction": "(object) => { return {...object} }", 3 "endPage": 50, 4 "endPageForReviews": 1, 5 "includeReviews": false, 6 "maxItems": 500, 7 "proxy": { 8 "useApifyProxy": true, 9 "apifyProxyGroups": [ 10 "RESIDENTIAL" 11 ] 12 }, 13 "reviewsOnly": false, 14 "startUrls": [ 15 "https://www.capterra.com/help-desk-software/?platform=%5B1%5D" 16 ] 17}
Hey Mathias Nestler!
You are absolutely right. It seems like we were not paginating on the listing pages at all. Sorry for this nasty bug and the inconvenience. We've fixed the problem and deployed the latest source code into the Apify Platform.
Please let us know if you need any further assistance. Best