# GitLab Projects Scraper — Repositories, Star Velocity & Topi (`spotless_studios/gitlab-projects-scraper`) Actor

Scrape public GitLab projects, repositories, star counts, forks, topic tags, and open issues via the official REST API. Tech scouting and enterprise open-source intelligence.

- **URL**: https://apify.com/spotless_studios/gitlab-projects-scraper.md
- **Developed by:** [Spotless Studios](https://apify.com/spotless_studios) (community)
- **Categories:** Developer tools
- **Security:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $1.00 / 1,000 gitlab project extracteds

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## GitLab Projects, Repositories & Star Velocity Scraper

Extract structured open-source projects, enterprise codebases, star metrics, forks, topic tags, and open issues from GitLab via the official REST API.

### Features

- **Enterprise Repository Telemetry**: Scrapes repository name, namespace, description, web URL, star count, forks, open issues count, visibility, default branch, topics, and recent activity timestamps.
- **Precision DevOps Filtering**: Filter by topic tags (e.g. `devops`, `ci-cd`, `docker`), minimum star counts, minimum forks, and recent commit/activity date cutoffs.
- **Automated Open-Source Intelligence**: Run on a schedule with `onlyNewItems` and `stateKey` to get alerts whenever newly created or trending enterprise repositories match your technology stack.
- **Lightweight & High Speed**: Consumes clean REST endpoints with zero headless browser overhead (128 MB memory).

### Input Parameters

| Parameter | Type | Default | Description |
|---|---|---|---|
| `searchQuery` | String | `"devops"` | Search keyword or tech stack |
| `topic` | String | `""` | Filter by repository topic tag |
| `minStars` | Integer | `0` | Minimum stargazers threshold |
| `minForks` | Integer | `0` | Minimum forks count threshold |
| `orderBy` | String | `"last_activity_at"` | `last_activity_at`, `star_count`, `created_at`, etc. |
| `sort` | String | `"desc"` | `desc` or `asc` |
| `lastActivityAfter`| String | `""` | Activity cutoff date (YYYY-MM-DD) |
| `maxResults` | Integer | `100` | Maximum projects to extract |
| `onlyNewItems` | Boolean | `false` | Monitoring mode: only emit newly tracked projects |
| `outputPreset` | String | `"full"` | `full`, `lean`, or `contacts` |

### Output Example

```json
{
  "projectId": "14839201",
  "name": "cloud-native-operator",
  "nameWithNamespace": "DevOps Tools / cloud-native-operator",
  "pathWithNamespace": "devops-tools/cloud-native-operator",
  "description": "Production Kubernetes operator for autonomous pipeline orchestration",
  "webUrl": "https://gitlab.com/devops-tools/cloud-native-operator",
  "starCount": 840,
  "forksCount": 92,
  "openIssuesCount": 7,
  "visibility": "public",
  "defaultBranch": "main",
  "topics": ["kubernetes", "operator", "golang", "devops"],
  "lastActivityAt": "2026-10-26T18:20:00.000Z",
  "scrapedAt": "2026-10-27T12:00:00.000Z"
}
```

***

### More from Spotless Studios

**[All actors on Apify](https://apify.com/spotless_studios)** · Support: spotless.studios.info@gmail.com

| Actor | Best for |
|-------|----------|
| [SLED Government Bids](https://apify.com/spotless_studios/sled-procurement-scraper) | Daily US gov RFP / bid alerts |
| [Webflow Experts](https://apify.com/spotless_studios/webflow-experts-scraper) | Webflow agency & freelancer leads |
| [Stripe Partners](https://apify.com/spotless_studios/stripe-partners-scraper) | Stripe implementation partner lists |
| [UK Planning Applications](https://apify.com/spotless_studios/uk-planning-applications-scraper) | UK planning leads + agent contacts |
| [Product Hunt](https://apify.com/spotless_studios/product-hunt-scraper) | Every PH launch + makers / websites |
| [Duunitori Jobs](https://apify.com/spotless_studios/duunitori-jobs-scraper) | Finland job listings |
| [Clutch Agencies](https://apify.com/spotless_studios/clutch-agencies-scraper) | Clutch agency prospecting |
| [Skool Communities](https://apify.com/spotless_studios/skool-communities-scraper) | Skool community & creator leads |

# Actor input Schema

## `gitlabUrl` (type: `string`):

Target GitLab instance URL (default 'https://gitlab.com', or any public self-hosted instance like 'https://gitlab.gnome.org' or 'https://gitlab.freedesktop.org').

## `searchQuery` (type: `string`):

Search project names and descriptions (e.g. 'kubernetes', 'cicd', 'security', 'embedded').

## `searchQueries` (type: `array`):

Optional list of multiple search queries to run sequentially in a single job.

## `topic` (type: `string`):

Filter by GitLab project topic tag (e.g. 'docker', 'rust', 'linux', 'machine-learning').

## `topics` (type: `array`):

Filter across multiple GitLab topic tags.

## `minStars` (type: `integer`):

Minimum star count.

## `maxStars` (type: `integer`):

Maximum star count.

## `minForks` (type: `integer`):

Minimum fork count.

## `orderBy` (type: `string`):

Field to order projects by.

## `sort` (type: `string`):

Descending or ascending.

## `createdAfter` (type: `string`):

Only keep projects created after this date (YYYY-MM-DD, ISO, or relative like '90 days').

## `lastActivityAfter` (type: `string`):

Only keep projects active after this date (YYYY-MM-DD, ISO, or relative like '30 days').

## `includeArchived` (type: `boolean`):

Include read-only archived projects.

## `projectPaths` (type: `array`):

Scrape specific GitLab projects directly by 'group/project' path, numeric ID, or URL (e.g. 'gitlab-org/gitlab', 'https://gitlab.com/inkscape/inkscape').

## `includeLanguages` (type: `boolean`):

Fetch each project's language breakdown to populate primaryLanguage and languages (% share per language).

## `gitlabToken` (type: `string`):

Optional GitLab PAT for higher rate limits or private/internal project access.

## `includeKeywords` (type: `array`):

Keep only projects matching these keywords or /regex/ in name, description, topics, or namespace.

## `excludeKeywords` (type: `array`):

Skip projects matching any of these keywords or /regex/.

## `keywordMatch` (type: `string`):

Require any or all includeKeywords to match.

## `onlyNewItems` (type: `boolean`):

Remember seen project IDs across runs and emit only newly discovered repositories.

## `stateKey` (type: `string`):

Separate state key per saved search or schedule.

## `maxResults` (type: `integer`):

Maximum number of projects to save.

## `outputPreset` (type: `string`):

Choose full record, lean summary, or contacts & links only.

## `outputFields` (type: `array`):

Keep only these specific fields in each saved record.

## `excludeFields` (type: `array`):

Remove specific fields from each saved record.

## `includeEmptyFields` (type: `boolean`):

When disabled, strips null and empty values from each saved record.

## `requiredFields` (type: `array`):

Only save records where every listed field has a non-empty value.

## `maxPages` (type: `integer`):

Maximum search pages per query (100 projects per page).

## `maxConcurrency` (type: `integer`):

Parallel requests when fetching direct project paths.

## `maxRequestRetries` (type: `integer`):

Retries per failed HTTP request.

## `requestTimeoutSecs` (type: `integer`):

Timeout per HTTP request.

## `proxyConfiguration` (type: `object`):

Optional proxy settings.

## `proxyEscalation` (type: `boolean`):

Automatically step up from direct to Apify datacenter/residential proxies if blocked.

## Actor input object example

```json
{
  "gitlabUrl": "https://gitlab.com",
  "searchQuery": "kubernetes",
  "orderBy": "star_count",
  "sort": "desc",
  "includeArchived": false,
  "includeLanguages": false,
  "keywordMatch": "any",
  "onlyNewItems": false,
  "stateKey": "default",
  "maxResults": 50,
  "outputPreset": "full",
  "includeEmptyFields": true,
  "maxPages": 15,
  "maxConcurrency": 5,
  "maxRequestRetries": 3,
  "requestTimeoutSecs": 30,
  "proxyConfiguration": {
    "useApifyProxy": false
  },
  "proxyEscalation": true
}
```

# Actor output Schema

## `items` (type: `string`):

Scrape public GitLab projects, repositories, star counts, forks, topic tags, and open issues via the official REST API. Tech scouting and enterprise open-source intelligence.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "gitlabUrl": "https://gitlab.com",
    "searchQuery": "kubernetes",
    "maxResults": 50,
    "proxyConfiguration": {
        "useApifyProxy": false
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("spotless_studios/gitlab-projects-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "gitlabUrl": "https://gitlab.com",
    "searchQuery": "kubernetes",
    "maxResults": 50,
    "proxyConfiguration": { "useApifyProxy": False },
}

# Run the Actor and wait for it to finish
run = client.actor("spotless_studios/gitlab-projects-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "gitlabUrl": "https://gitlab.com",
  "searchQuery": "kubernetes",
  "maxResults": 50,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}' |
apify call spotless_studios/gitlab-projects-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,spotless_studios/gitlab-projects-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/cbr5xuJiBELjLRjou/builds/sJSQPLWsksLCkOBaw/openapi.json