Go Packages Scraper (pkg.go.dev)

Scrape Go package metadata from pkg.go.dev and the Go module proxy. Search packages by keyword or fetch specific modules by their import path.

Features

• Search Packages — find Go packages matching any keyword (e.g., "web framework", "database ORM", "CLI")
• Get By Module — fetch detailed metadata for specific modules by their Go import path
• Extracts version, license, synopsis, Go version requirement, direct imports, and importedBy count
• Sources data from pkg.go.dev search results and the official Go module proxy (proxy.golang.org)
• No authentication or API keys required

Input

Field	Type	Description	Default
mode	select	searchPackages or getByModule	searchPackages
searchQuery	string	Keyword to search (e.g. "gin web framework")	—
modulePaths	array	Module import paths for getByModule (e.g. ["github.com/gin-gonic/gin"])	[]
maxItems	integer	Max records to return (1–500)	50

Example: Search Packages

{
  "mode": "searchPackages",
  "searchQuery": "gin web framework",
  "maxItems": 20
}

Example: Get By Module

{
  "mode": "getByModule",
  "modulePaths": [
    "github.com/gin-gonic/gin",
    "github.com/gorilla/mux",
    "gorm.io/gorm"
  ],
  "maxItems": 10
}

Output

Each record contains:

Field	Description
modulePath	Full Go module path (e.g. github.com/gin-gonic/gin)
packageName	Last segment of module path (e.g. gin)
version	Latest published version (e.g. v1.9.1)
synopsis	Short description of the package
license	License identifier (e.g. MIT, Apache-2.0)
publishedAt	ISO timestamp of latest version release
goVersion	Minimum Go version required (e.g. go1.20)
imports	List of direct module dependencies
importedBy	Number of other packages that import this one
repositoryUrl	GitHub/GitLab repository URL
sourceUrl	Link to package page on pkg.go.dev
recordType	Always "package"
scrapedAt	ISO timestamp when record was scraped

Sample Output

{
  "modulePath": "github.com/gin-gonic/gin",
  "packageName": "gin",
  "version": "v1.12.0",
  "synopsis": "Gin is a HTTP web framework written in Go",
  "license": "MIT",
  "publishedAt": "Feb 28, 2026",
  "goVersion": "go1.20",
  "imports": ["github.com/gin-contrib/sse", "github.com/go-playground/validator/v10"],
  "importedBy": 183243,
  "repositoryUrl": "https://github.com/gin-gonic/gin",
  "sourceUrl": "https://pkg.go.dev/github.com/gin-gonic/gin",
  "recordType": "package",
  "scrapedAt": "2026-01-01T12:00:00+00:00"
}

Use Cases

• Dependency research — explore popular packages before adopting them
• Security audits — check what packages are widely used and their licenses
• Competitive analysis — compare package adoption and import counts
• Tech stack monitoring — track version updates across your Go dependencies
• Developer tools — build package registries or recommendation systems

FAQ

Does this require a Go installation? No. The actor fetches data directly from pkg.go.dev and the Go module proxy over HTTP.

Why are some fields missing on some records? Fields like synopsis, license, and goVersion are optional and only included when present in the source data.

What is importedBy? The number of public Go packages that directly import this module, as reported by pkg.go.dev.

Can I search for private modules? No. This scraper only accesses publicly available packages on pkg.go.dev.

What is the rate limit? pkg.go.dev and the Go module proxy are public services. The actor respects reasonable delays between requests to avoid overloading them.

How current is the data? The actor fetches live data from pkg.go.dev and the Go module proxy at scrape time.