GitLab Public Projects API Scraper

Exports GitLab public project metadata — stars, forks, topics, namespace, and repo URLs — pulled directly from GitLab's official REST API. Built for developers, researchers, and lead-gen teams who need structured data on public GitLab projects (open source tooling surveys, dependency/ecosystem mapping, sourcing companies or maintainers running self-hosted or public GitLab groups) without writing their own API pagination and auth handling.

Why this scraper

• Pulls straight from GitLab's official JSON API (gitlab.com/api/v4/projects) rather than parsing rendered HTML pages, so there's no markup to break and no parsing errors — output reflects the API's live data at request time.
• Returns 24 flat fields per project, including full namespace details (group/user, path, web URL) and both HTTPS/SSH clone URLs, in one row — no follow-up calls needed to resolve namespace info.
• Priced at $0.0002 per record, well under a per-record cost of $0.0004 and far cheaper than per-start pricing models once you're pulling more than a handful of projects.

Output fields

Field	Type	Description
id	integer	GitLab project ID
name	string	Project name
name_with_namespace	string	Project name including owning namespace
path	string	URL-safe project path
path_with_namespace	string	Full path including namespace, e.g. gitlab-org/gitlab
description	string	Project description text
created_at	string	ISO timestamp the project was created
last_activity_at	string	ISO timestamp of last project activity
default_branch	string	Default git branch name
star_count	integer	Number of stars
forks_count	integer	Number of forks
visibility	string	Project visibility level (e.g. public)
web_url	string	GitLab web URL for the project
http_url_to_repo	string	HTTPS clone URL
ssh_url_to_repo	string	SSH clone URL
readme_url	string	URL to the project README
avatar_url	string	Project avatar image URL
topics	string	Comma-separated list of project topics/tags
namespace_id	integer	ID of the owning namespace (group or user)
namespace_name	string	Name of the owning namespace
namespace_path	string	Path of the owning namespace
namespace_kind	string	Namespace kind: group or user
namespace_full_path	string	Full path of the owning namespace
namespace_web_url	string	Web URL of the owning namespace

Input

{
  "startUrls": [
    { "url": "https://gitlab.com/api/v4/projects?per_page=50&order_by=star_count" }
  ],
  "maxItems": 50
}

Output

{
  "id": 13083,
  "name": "GitLab FOSS",
  "name_with_namespace": "GitLab.org / GitLab FOSS",
  "path": "gitlab-foss",
  "path_with_namespace": "gitlab-org/gitlab-foss",
  "description": "GitLab FOSS is a read-only mirror of GitLab, with all proprietary code removed.\n\nThis project was previously used to host GitLab Community Edition, but all development has now moved to https://gitlab.com/gitlab-org/gitlab.\n",
  "created_at": "2013-09-26T06:02:36.000Z",
  "last_activity_at": "2026-08-29T13:24:14.593Z",
  "default_branch": "master",
  "star_count": 7171,
  "forks_count": 8276,
  "visibility": "public",
  "web_url": "https://gitlab.com/gitlab-org/gitlab-foss",
  "http_url_to_repo": "https://gitlab.com/gitlab-org/gitlab-foss.git",
  "ssh_url_to_repo": "git@gitlab.com:gitlab-org/gitlab-foss.git",
  "readme_url": "https://gitlab.com/gitlab-org/gitlab-foss/-/blob/master/README.md",
  "avatar_url": "https://gitlab.com/uploads/-/system/project/avatar/13083/project_avatar.png?v=1788009854",
  "topics": "Canonical, hacktoberfest, infra-mgmt Managed",
  "namespace_id": 9970,
  "namespace_name": "GitLab.org",
  "namespace_path": "gitlab-org",
  "namespace_kind": "group",
  "namespace_full_path": "gitlab-org",
  "namespace_web_url": "https://gitlab.com/groups/gitlab-org"
}

Pricing

Pay $0.0002 per project record scraped. Pulling 50 projects (one API page) costs about $0.01; scraping 5,000 projects costs about $1.00.

Use cases

• Tracking star/fork growth of open source projects under a specific GitLab group (e.g. monitoring gitlab-org subprojects over time) for an internal OSS health dashboard.
• Building a lead list of companies and teams running active public GitLab groups, using namespace and web_url fields to find contact-worthy organizations.
• Auditing topics and default branches across a namespace's projects to standardize CI/CD conventions or find unmaintained repos (via last_activity_at).