pkg.go.dev Scraper - Go Packages & Modules

Discover and extract Go packages and modules from pkg.go.dev by search query - no API key, no login. Feed it search terms like http router, json, or cli and get back clean, structured records for every matching Go module: import path, synopsis, latest version, published date, imported-by count, license and canonical URL.

Perfect for Go package discovery, dependency research, building developer tooling, and open-source intelligence on the Go ecosystem.

Roughly $0.5 per 1,000 packages on the Apify platform.

Features

• 🔎 Search-driven - one or many queries, results merged and de-duplicated by import path
• 📦 Rich metadata - import path, package name, synopsis, version, published date, imported-by count, license
• 🔢 Imported-by as a number - "99,459" is parsed to 99459 so you can sort and rank by popularity
• 🚫 No key required - scrapes the public pkg.go.dev search directly (curl_cffi Chrome fingerprint + urllib fallback)
• ⚙️ Configurable limits - cap total items from 1 up to 1,000
• 🧱 Clean schema - every field nullable, permissive dataset schema, tidy overview table view

Input

Field	Type	Description
mode	select	Scraping mode. Currently search (queries → Go packages).
queries	array	Search terms to look up on pkg.go.dev. Default: ["http router", "json", "cli"].
maxItems	integer	Max total package items across all queries. Default 100, max 1000.

Example input

{
  "mode": "search",
  "queries": ["http router", "orm", "grpc"],
  "maxItems": 200
}

Output

Each dataset item is one Go package/module:

{
  "path": "github.com/gorilla/mux",
  "name": "mux",
  "synopsis": "Package mux implements a request router and dispatcher.",
  "version": "v1.8.1",
  "published": "Oct 18, 2023",
  "imported_by": 99459,
  "license": "BSD-3-Clause",
  "url": "https://pkg.go.dev/github.com/gorilla/mux",
  "source": "pkg-go-dev",
  "scraped_at": "2026-07-24T12:00:00+00:00"
}

Use cases

• Go package discovery - find the most-used libraries for a task, ranked by imported-by count
• Dependency research - audit alternatives, licenses and adoption before adding a dependency
• Developer tooling - power internal catalogs, package browsers and CI policy checks
• OSS intelligence - track the Go ecosystem, licensing mix and popularity trends

Related scrapers

• GitHub Scraper
• npms Search Scraper
• Bundlephobia Scraper
• crates.io Scraper

Notes

This Actor scrapes publicly available pages from pkg.go.dev. It reads only public package metadata and stores no personal data. Respect pkg.go.dev's terms and use reasonable request volumes.