Capterra Scraper avatar

Capterra Scraper

Try for free

7 days trial then $40.00/month - No credit card required now

View all Actors
Capterra Scraper

Capterra Scraper

epctex/capterra-scraper
Try for free

7 days trial then $40.00/month - No credit card required now

Extract valuable data from the Capterra software database with our Capterra Scraper. Gather product information, related products, insights, portfolio, real client reviews, and more. Explore top software listings for your business.

MM

Does not paginate

Closed

MMore opened this issue
a year ago

Hey, I thought it would paginate automatically but it does not. Here is my 2nd try where I set endPage to a high number. Docs says when it's empty it would scrape all, but also then it's only 25 results. Am I doing sth wrong?

1{
2  "customMapFunction": "(object) => { return {...object} }",
3  "endPage": 50,
4  "endPageForReviews": 1,
5  "includeReviews": false,
6  "maxItems": 500,
7  "proxy": {
8    "useApifyProxy": true,
9    "apifyProxyGroups": [
10      "RESIDENTIAL"
11    ]
12  },
13  "reviewsOnly": false,
14  "startUrls": [
15    "https://www.capterra.com/help-desk-software/?platform=%5B1%5D"
16  ]
17}
TE

tugkan_epctex

a year ago

Hey Mathias Nestler!

You are absolutely right. It seems like we were not paginating on the listing pages at all. Sorry for this nasty bug and the inconvenience. We've fixed the problem and deployed the latest source code into the Apify Platform.

Please let us know if you need any further assistance. Best

Developer
Maintained by Community

Actor Metrics

  • 17 monthly users

  • 4 stars

  • 98% runs succeeded

  • 1.2 days response time

  • Created in Nov 2021

  • Modified 9 hours ago

Categories