Capterra Scraper
Pricing
$40.00/month + usage
Capterra Scraper
Extract valuable data from the Capterra software database with our Capterra Scraper. Gather product information, related products, insights, portfolio, real client reviews, and more. Explore top software listings for your business.
1.0 (1)
Pricing
$40.00/month + usage
8
Total users
663
Monthly users
33
Runs succeeded
98%
Issues response
3.9 days
Last modified
12 hours ago
Failed to fetch any data
Open
From logs:
2025-06-06T09:06:52.027Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Request blocked - received 403 status code. 2025-06-06T09:06:52.028Z {"id":"4BwBFgurVszSlQO","url":"https://www.capterra.com/p/87750/JazzHR","retryCount":17} 2025-06-06T09:06:58.925Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Request blocked - received 403 status code. 2025-06-06T09:06:58.926Z {"id":"4BwBFgurVszSlQO","url":"https://www.capterra.com/p/87750/JazzHR","retryCount":18} 2025-06-06T09:07:05.140Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Request blocked - received 403 status code. 2025-06-06T09:07:05.141Z {"id":"4BwBFgurVszSlQO","url":"https://www.capterra.com/p/87750/JazzHR","retryCount":19} 2025-06-06T09:07:11.431Z WARN PlaywrightCrawler: Reclaiming failed request back to the list or queue. Request blocked - received 403 status code. 2025-06-06T09:07:11.432Z {"id":"4BwBFgurVszSlQO","url":"https://www.capterra.com/p/87750/JazzHR","retryCount":20} 2025-06-06T09:07:17.757Z ERROR PlaywrightCrawler: Request failed and reached maximum retries. Error: Request blocked - received 403 status code. 2025-06-06T09:07:17.758Z at PlaywrightCrawler._throwOnBlockedRequest (/home/myuser/node_modules/@crawlee/basic/internals/basic-crawler.js:778:19) 2025-06-06T09:07:17.759Z at PlaywrightCrawler._responseHandler (/home/myuser/node_modules/@crawlee/browser/internals/browser-crawler.js:380:22) 2025-06-06T09:07:17.760Z at PlaywrightCrawler._runRequestHandler (/home/myuser/node_modules/@crawlee/browser/internals/browser-crawler.js:262:24) 2025-06-06T09:07:17.761Z at async PlaywrightCrawler._runRequestHandler (/home/myuser/node_modules/@crawlee/playwright/internals/playwright-crawler.js:114:9) 2025-06-06T09:07:17.762Z at async wrap (/home/myuser/node_modules/@apify/timeout/cjs/index.cjs:54:21) {"id":"4BwBFgurVszSlQO","url":"https://www.capterra.com/p/87750/JazzHR","method":"GET","uniqueKey":"https://www.capterra.com/p/87750/JazzHR"} 2025-06-06T09:07:17.877Z INFO PlaywrightCrawler: All requests from the queue have been processed, the crawler will shut down. 2025-06-06T09:07:18.861Z INFO PlaywrightCrawler: Final request statistics: {"requestsFinished":0,"requestsFailed":1,"retryHistogram":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,1],"requestAvgFailedDurationMillis":6035,"requestAvgFinishedDurationMillis":null,"requestsFinishedPerMinute":0,"requestsFailedPerMinute":0,"requestTotalDurationMillis":6035,"requestsTotal":1,"crawlerRuntimeMillis":151242} 2025-06-06T09:07:18.862Z INFO PlaywrightCrawler: Error analysis: {"totalErrors":1,"uniqueErrors":1,"mostCommonErrors":["1x: Request blocked - received 403 status code. (/home/myuser/node_modules/@crawlee/basic/internals/basic-crawler.js:778:19)"]} 2025-06-06T09:07:18.863Z INFO PlaywrightCrawler: Finished! Total 1 requests: 0 succeeded, 1 failed. {"terminal":true}
unnamedteam
Tried multiple times, it always fail with 403, seems Cloudeflare detects this crawler as bot
Hey there,
Thank you for reaching out, and letting us know about your inquiry. Can you please share your Run ID, so that the team can investigate it in detail?
Best
unnamedteam
I have tried with Web Unblocker proxy. I see new error 401 now, still no results. I have tried to test this proxy manually and can confirm I can fetch Capterra page successfully - without proxy I get Cloudflare page.
unnamedteam
unnamedteam
Run without proxy (with Apify proxy): https://console.apify.com/actors/mZrVfFsEelXdq6cgj/runs/WB0uviXo6Smk29EwZ#log
unnamedteam
Without proxy, failing but marking run as success: https://console.apify.com/actors/mZrVfFsEelXdq6cgj/runs/DUqOLuFUdClSZXqdl#log
Hey there,
I passed this information to the Engineering team and will get back to you as soon as possible.
Best
isharis
I am experincing the same issue.
