Capterra Scraper avatar

Capterra Scraper

Try for free

7 days trial then $40.00/month - No credit card required now

View all Actors
Capterra Scraper

Capterra Scraper

epctex/capterra-scraper
Try for free

7 days trial then $40.00/month - No credit card required now

Extract valuable data from the Capterra software database with our Capterra Scraper. Gather product information, related products, insights, portfolio, real client reviews, and more. Explore top software listings for your business.

ON

Scraping Issues

Closed

ontargetai opened this issue
10 months ago

Been having problems with scraping for the last two months. At the moment this is the latest problem.

12024-02-06T09:14:42.905Z WARN  PlaywrightCrawler: Reclaiming failed request back to the list or queue. TypeError: Cannot read properties of undefined (reading 'id')
22024-02-06T09:14:42.906Z     at Object.scrapeProductDetail (file:///home/myuser/src/extractors.js:53:41)
32024-02-06T09:14:42.907Z     at file:///home/myuser/src/routes.js:188:30
42024-02-06T09:14:42.908Z     at func (/home/myuser/node_modules/@crawlee/core/router.js:172:44)
52024-02-06T09:14:42.909Z     at PlaywrightCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:134:15)
62024-02-06T09:14:42.910Z     at async wrap (/home/myuser/node_modules/@apify/timeout/index.js:52:21) {"id":"fsHbGyp73RBCiyA","url":"https://www.capterra.com/p/146652/Airtable/","retryCount":7}
epctex avatar

epctex (epctex)

10 months ago

Hey there,

Thank you very much for reaching out and letting us know about the problem. We resolved the problem on the Capterra and fetching the products is fixed now. However, review retrieval is still under development and we are trying to resolve it. Due to the latest changes on Capterra, the actor has instability at the current moment.

Please let us know if you need any further assistance, Best

OO

ontargetai-owner

9 months ago

Hi there,

OO

ontargetai-owner

9 months ago

Hi there,

Another thing we are contemplating and we need some more info from you guys, is upgrading to *Scale or Business Plan. * While one benefit would be to allow more users to scrape data at the same time, what at this point is even more important at this moment in time, is to understand if these superior plans *would help us scrape faster and how much faster? *

While scraping a few seconds faster is not added value, cutting the scraping time in half would be interesting to us. Thank you

Magdalena Baciu

Developer
Maintained by Community

Actor Metrics

  • 16 monthly users

  • 4 stars

  • 98% runs succeeded

  • 1.2 days response time

  • Created in Nov 2021

  • Modified 10 hours ago

Categories