AppSumo Public Software Deal Scraper

Extract useful, one-time snapshots from public AppSumo deal pages without logging in or using private APIs. The Actor discovers product links from public listing pages, follows a bounded number of pagination pages, deduplicates deal URLs, and writes explicit ok, partial, blocked, unavailable, and error records instead of silently dropping failures.

Extracted fields

Each deal record can include the product/deal title, vendor, tagline, pricing and currency, lifetime-term signal, deal tier, category, rating, review count, deal status, description, canonical URL, public images, discovery seed, and extraction timestamp. JSON-LD and public metadata are preferred, with conservative text fallbacks because AppSumo markup can change.

Input

startUrls accepts HTTPS appsumo.com listing or deal URLs. The default is https://appsumo.com/products/. The default health-test path is intentionally bounded to one page and one record; increase maxItems and maxPages explicitly for catalog runs. requestDelaySecs defaults to 1, and maxConcurrency defaults to 1. includeImages can disable image URLs. Optional Apify proxy configuration is supported, but users remain responsible for source terms and lawful use.

No login cookies, private API tokens, CAPTCHA solving, challenge bypassing, or protection evasion is supported. Public pages may be unavailable or blocked; those conditions are recorded and the run summary explains them.

Output and limits

Results are stored in the default dataset. A run can contain error/status records for pages that could not be extracted. Crawling is capped by maxItems, maxPages, 600 requests per run, three browser workers, a 45-second navigation timeout, and two retries per request. Results are snapshots, not a guarantee of current availability or price.

Local development

npm ci
npm test
npm run build
npm start

Use a small startUrls list and maxItems: 1 for a smoke run. Respect AppSumo terms, robots guidance, rate limits, and applicable law.