GitHub Repository Details Scraper

Extracts full stats and metadata — stars, forks, watchers, open issues, primary language, topics, license, default branch, creation date, last commit date, archived status, and homepage URL — from any GitHub repository page URL. Built for developers, researchers, and agents who need per-repo metadata (license, topics, archived status, last commit) for a specific list of repos rather than a snapshot of the trending page.

Why this scraper

• Takes arbitrary repo URLs as input, so you can pull full metadata for exactly the repos you care about — not just whatever happens to be trending that day.
• Returns license, topics, default branch, archived status, and last commit date alongside stars/forks — fields that a name/stars/forks listing scrape doesn't surface.
• Priced per repo scraped, so a run of 3 repos costs the same per-unit as a run of 3,000 — you don't pay a flat per-run fee regardless of how much you actually get back.

Output fields

Field	Type	Description
repoUrl	string	Canonical URL of the repository page
owner	string	GitHub username or org that owns the repo
repoName	string	Repository name
description	string	Short repo description shown at the top of the page
stars	integer	Total star count
forks	integer	Total fork count
watchers	integer	Total watcher count
openIssues	integer	Number of open issues
primaryLanguage	string	Dominant programming language of the repo
topics	string	Comma-separated list of repo topic tags
license	string	License name, e.g. 'Apache-2.0'
defaultBranch	string	Name of the default branch
createdAt	string	ISO date the repository was created
lastCommitDate	string	ISO date of the most recent commit on the default branch
isArchived	boolean	Whether the repository is archived
homepageUrl	string	External homepage/project URL listed on the repo, if any

Input

{
  "startUrls": [
    { "url": "https://github.com/psf/requests" }
  ],
  "maxItems": 50
}

startUrls is a list of repo page URLs to scrape. maxItems caps how many will be processed in a single run.

Output

{
  "repoUrl": "https://github.com/psf/requests",
  "owner": "psf",
  "repoName": "requests",
  "description": "A simple, yet elegant, HTTP library. Contribute to psf/requests development by creating an account on GitHub.",
  "stars": 54262,
  "forks": 10078,
  "watchers": null,
  "openIssues": 147,
  "primaryLanguage": "",
  "topics": "",
  "license": "LICENSE",
  "defaultBranch": "main",
  "createdAt": "2011-02-13T18:38:17.000Z",
  "lastCommitDate": "",
  "isArchived": false,
  "homepageUrl": "https://requests.readthedocs.io/en/latest/"
}

Pricing

Pay $0.002 per repository successfully scraped. A run of 50 repos costs $0.10; scraping a list of 500 repos costs $1.00. There is no separate per-run or per-start charge — you pay only for repos actually returned.

Use cases

• Tracking a fixed watchlist of dependency repos (e.g. everything in a requirements.txt or package.json) for license changes or archival status before a release.
• Building a comparison table of stars, forks, and last commit date across a shortlist of candidate open-source libraries during a vendor evaluation.
• Feeding repo metadata (license, topics, primary language) into an internal catalog or agent tool that needs structured facts about specific GitHub projects.