7 days trial then $40.00/month - No credit card required now
Capterra Scraper
7 days trial then $40.00/month - No credit card required now
Extract valuable data from the Capterra software database with our Capterra Scraper. Gather product information, related products, insights, portfolio, real client reviews, and more. Explore top software listings for your business.
Scraping Issues
Closed
Been having problems with scraping for the last two months. At the moment this is the latest problem.
12024-02-06T09:14:42.905Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. TypeError: Cannot read properties of undefined (reading 'id') 22024-02-06T09:14:42.906Z at Object.scrapeProductDetail (file:///home/myuser/src/extractors.js:53:41) 32024-02-06T09:14:42.907Z at file:///home/myuser/src/routes.js:188:30 42024-02-06T09:14:42.908Z at func (/home/myuser/node_modules/@crawlee/core/router.js:172:44) 52024-02-06T09:14:42.909Z at PlaywrightCrawler.requestHandler [as userProvidedRequestHandler] (file:///home/myuser/src/main.js:134:15) 62024-02-06T09:14:42.910Z at async wrap (/home/myuser/node_modules/@apify/timeout/index.js:52:21) {"id":"fsHbGyp73RBCiyA","url":"https://www.capterra.com/p/146652/Airtable/","retryCount":7}
Hey there,
Thank you very much for reaching out and letting us know about the problem. We resolved the problem on the Capterra and fetching the products is fixed now. However, review retrieval is still under development and we are trying to resolve it. Due to the latest changes on Capterra, the actor has instability at the current moment.
Please let us know if you need any further assistance, Best
ontargetai-owner
Hi there,
ontargetai-owner
Hi there,
Another thing we are contemplating and we need some more info from you guys, is upgrading to *Scale or Business Plan. * While one benefit would be to allow more users to scrape data at the same time, what at this point is even more important at this moment in time, is to understand if these superior plans *would help us scrape faster and how much faster? *
While scraping a few seconds faster is not added value, cutting the scraping time in half would be interesting to us. Thank you
Magdalena Baciu
epctex
