🧩 Capterra Scraper (capterra-scraper) extracts rich software reviews & details from Capterra to power B2B research, lead gen, and competitor analysis. ⚡ Fast, structured, and export-ready for data-driven decisions. 📊
🚀 Root-cause fix for "under maintenance": replaced the headed-browser
(patchright) + mandatory-residential-proxy fetch with a lightweight HTTP
fetch (curl_cffi, real Chrome TLS impersonation) using an AI-search-crawler
User-Agent. Capterra serves its full RSC data to that UA with no Cloudflare
challenge, from any IP — so the Actor now succeeds straight from Apify's
datacenter servers instead of getting blocked and flagged.
🪶 No browser, no Xvfb, no Chrome — much smaller image, faster runs, lower
memory.
🛡️ Proxy is now optional (direct → datacenter → residential ladder kept
only as a resilience fallback).
🔢 maxItems now drives listing depth (pages as far as needed to hit the
requested count); run-wide product de-duplication across all start URLs.
🧩 Richer output: relatedProducts populated from on-page alternatives;
more robust product/review parsing.
0.1 — Initial release
🧩 Scrape Capterra product detail pages and category/listing pages.
💬 Optional reviews attached to each product, or a dedicated reviews-only mode.
🔗 Bulk URL input with automatic de-duplication and a global maxItems cap.
📄 Per-URL listing pagination (endPage) and per-product review pagination (endPageForReviews).
🛡️ Residential-first proxy policy: always residential (3 retries); a custom proxy, if supplied, is tried first (3 retries) then falls back to residential.
💾 Live, per-item saving to the dataset — a crash mid-run still leaves a partial dataset.
🖥️ Powered by a real, headed browser (patchright) to clear Capterra's bot challenge.