Capterra Scraper avatar
Capterra Scraper
Try for free

7 days trial then $40.00/month - No credit card required now

View all Actors
Capterra Scraper

Capterra Scraper

epctex/capterra-scraper
Try for free

7 days trial then $40.00/month - No credit card required now

Extract valuable data from the Capterra software database with our Capterra Scraper. Gather product information, related products, insights, portfolio, real client reviews, and more. Explore top software listings for your business.

User avatar

Trying to scrape capterra but docker always fails at request number 78

Closed

euhoro opened this issue
a year ago

is there a way to limit the scraper to 70 ?

User avatar

tugkan

a year ago

Hey there!

Is it possible to share the run URL with us? We'd like to investigate what might be wrong with the situation.

Best

User avatar

euhoro

a year ago

Hi and thank you for your reply

We are currently evaluating a couple of solutions and Apify looks the most mature product unfortunately we couldn't make it work - We tried to scrape this url including reviews . it doesn't matter much how many pages as long we can get some results https://www.capterra.com/p/169007/Wix/

I already tried setting Maximum number of listing items to 5 or 20 but without luck . the docker starts and seems it scrapes about 78 pages but then it crashes

this is the url of our account - Home (apify.com) https://console.apify.com/organization/ZiCENiDquh2LWGzRE/

User avatar

tugkan

a year ago

Hey there,

Thank you very much again for using our Public actor. We just integrated a new field called "Reviews end page" or "endPageReviews". You can setup a number there to end the pages on the reviews. If you'd like to get only the first 15 pages of reviews, putting the number 15 on that field would be ideal for you.

Please let me know if there is anything that we can help you with.

Best

Developer
Maintained by Community
Actor metrics
  • 24 monthly users
  • 99.1% runs succeeded
  • 0.3 days response time
  • Created in Nov 2021
  • Modified 1 day ago