# GetApp Software Listings Scraper (`artsiom_k/getapp-scraper`) Actor

Scrape GetApp.com software listings — ratings, reviews, pricing plans, features, and category taxonomy — with built-in delta mode. No login required.

- **URL**: https://apify.com/artsiom\_k/getapp-scraper.md
- **Developed by:** [Artsiom Kunitsyn](https://apify.com/artsiom_k) (community)
- **Categories:** Lead generation
- **Stats:** 2 total users, 1 monthly users, 66.7% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $5.00 / 1,000 results

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## getapp-scraper

Scrapes software listings from [GetApp.com](https://www.getapp.com) (Gartner Digital Markets'
software-review and lead-gen site, sister to Capterra) — ratings, reviews, pricing plans,
features, categories, and more — via the site's own sitemap and each listing's server-rendered
Next.js data. No login required.

### Contents

- [Key features](#key-features)
- [Output](#output)
- [Input](#input)
- [Input examples](#input-examples)
- [Incremental (delta) mode](#incremental-delta-mode)
- [FAQ](#faq)

### 🔑 Key features

- **Rich, structured fields from the page's own Next.js data**, not just the page's basic
  schema.org markup — rating, review count, full pricing-plan breakdown, features, integrations,
  supported platforms, typical customers, alternatives, pros/cons, support/training options, FAQ.
- **No internal API used.** GetApp's own `/api/*` exists but is robots-disallowed — every field
  here comes from the same server-rendered HTML a browser gets, never that API.
- **Delta mode built in.** Every run classifies each item as `new`, `changed`, `unchanged`, or
  `delisted` against a persisted baseline — pay for what changed, not a full re-scrape every time.
- **Confirmed-dead listings are never re-fetched.** A removed listing returns a plain HTTP 404 —
  tracked in a persisted registry so a future run skips it without a wasted request.
- **`maxItems` defaults to 50** — a fast, cheap preview, and what keeps an unconfigured run within
  Apify's automated 5-minute QA check. Clear it (`null`) for a full crawl (~45,000 listings as of
  this build).

### 📋 Output

One dataset item per software listing — see
[`.actor/dataset_schema.json`](.actor/dataset_schema.json) for the full field list.

**Example record (trimmed):**

```json
{
  "source": "getapp",
  "external_id": "8c7f8bf5-dbf6-47ee-9df7-a6d200b64092",
  "url": "https://www.getapp.com/customer-management-software/a/salesforce/",
  "name": "Salesforce Sales Cloud",
  "company_name": "Salesforce",
  "tagline": "Cloud-based CRM and sales automation software",
  "rating_avg": 4.4,
  "num_reviews": 18810,
  "categories": [{ "id": "...", "name": "Business Management", "slug": "business-management" }],
  "pricing_amount": 25.0,
  "pricing_currency": "USD",
  "pricing_periodicity": "month",
  "pricing_model": "Per User",
  "pricing_raw": { "plans": [{ "name": "Starter Suite", "startingPrice": 25 }] },
  "change_type": "new"
}
```

Several fields (`features_raw`, `integrations_raw`, `alternatives_raw`, `pros_cons_raw`,
`support_options_raw`, `training_options_raw`, `faq_raw`, `vendor_raw`) are kept as the site's own
raw nested JSON rather than flattened into fixed columns — real but not fully mapped shapes, same
call as `tappan-collective-scraper`'s `tags`/`body_html` fields.

### 🔧 Input

| Field | Type | Default | Description |
|---|---|---|---|
| `startUrls` | array | — | Specific listing URLs to scrape directly instead of the full sitemap. |
| `maxItems` | integer | `50` | Stop after pushing this many items. Set to `null` for a full crawl. |
| `mode` | string | `auto` | `auto` / `full` / `incremental` — see [Incremental mode](#incremental-delta-mode). |
| `concurrency` | integer | `15` | How many listing pages to fetch in parallel. |
| `impersonate` | string | `chrome` | curl\_cffi TLS-impersonation target. |
| `proxyConfiguration` | object | **RESIDENTIAL** | Apify Proxy config. Required — see FAQ. |

### 📥 Input examples

**Default preview (50 listings):**

```json
{}
```

**Full catalog:**

```json
{ "maxItems": null }
```

### 🔁 Incremental (delta) mode

`auto` mode does a full scan the first time it runs, then only pushes new/changed items on later
runs. Only an uncapped, unscoped run (no `maxItems` limit reached, no `startUrls`, no item errors)
can detect delistings or update the baseline.

### ❓ FAQ

**Does this need a proxy?**
Yes, a real requirement — not the usual "leave it off" answer most actors in this fleet give.
GetApp.com returns HTTP 403 to a real share of requests from Apify's datacenter/cloud IP ranges
regardless of TLS fingerprint (confirmed via a live cloud probe: chrome/firefox/safari
impersonation all landed only ~55-65% clean with no proxy) — a genuine IP-reputation block, not a
fingerprint issue. Apify's **Residential** proxy group clears it (100% clean in that same probe)
and is the schema default; leaving it off or switching to a datacenter group will likely cause
sustained failures.

**Why are some fields raw/unflattened JSON instead of proper columns?**
Those fields (features, integrations, alternatives, pros/cons, support/training options, FAQ,
vendor) have real but not-yet-fully-mapped shapes across GetApp's ~45,000 listings — kept as
opaque passthrough JSON rather than guessed at, to avoid a schema crash on a shape this build
didn't happen to sample.

# Actor input Schema

## `startUrls` (type: `array`):

Optional list of specific GetApp software profile URLs (https://www.getapp.com/{category-slug}/a/{vendor-slug}/) to scrape directly, instead of discovering via the full profiles sitemap (~45,000 listings). A startUrls-scoped run cannot detect delistings or update the incremental baseline.

## `maxItems` (type: `integer`):

Stop after pushing this many dataset items. Defaults to 50 — a fast, cheap preview, and what keeps an unconfigured run within Apify's automated 5-minute QA check. A full, uncapped sitemap crawl covers the whole catalog (~45,000 listings as of this build) — raise this or clear it (set to null) for that.

## `mode` (type: `string`):

"auto" (recommended): full scan on the first run, incremental (new/changed only) afterwards. "full": always push every item and refresh the baseline — schedule this periodically to catch delistings. "incremental": always push only new/changed items. Only a plain, unscoped sitemap crawl (no startUrls) can detect delistings or update the baseline.

## `concurrency` (type: `integer`):

How many software profile pages to fetch in parallel.

## `impersonate` (type: `string`):

curl\_cffi browser TLS-impersonation target. Defaults to "chrome" internally — the only fingerprint verified 100% clean on real Apify infra when paired with the mandatory Residential proxy below.

## `proxyConfiguration` (type: `object`):

Apify Proxy configuration. Defaults to the RESIDENTIAL group and should be left there: as of this build, GetApp.com returns HTTP 403 to roughly 35-45% of requests from Apify's datacenter/cloud IPs regardless of TLS fingerprint (a real IP-reputation block, confirmed via a live cloud probe) — only Residential proxy cleared it (100% clean in that same probe). Turning this off or switching to a datacenter group will very likely cause sustained failures.

## Actor input object example

```json
{
  "maxItems": 50,
  "mode": "auto",
  "concurrency": 15,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ]
  }
}
```

# Actor output Schema

## `results` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {};

// Run the Actor and wait for it to finish
const run = await client.actor("artsiom_k/getapp-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {}

# Run the Actor and wait for it to finish
run = client.actor("artsiom_k/getapp-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{}' |
apify call artsiom_k/getapp-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,artsiom_k/getapp-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/nR2aFkd4HG2cbJdE1/builds/Iif5b2jQgNPBaQCpq/openapi.json