GitHub Trending Scraper

Scrape GitHub trending repositories and developers. Filter by programming language and time range. Extract stars, forks, descriptions, contributors, and daily star growth.

Features

• Trending Repositories — Top repos by daily/weekly/monthly stars
• Trending Developers — Top developers with their popular repos
• Language Filters — Filter by one or multiple programming languages
• README Extraction — Optionally fetch full README content
• Spoken Language — Filter by spoken language (en, zh, es, etc.)

Input

Field	Type	Description
scrapeType	string	repositories or developers
timeRange	string	daily, weekly, or monthly
languages	array	Programming languages to filter (e.g., python, javascript)
spokenLanguage	string	Spoken language code (e.g., en, zh)
includeReadme	boolean	Fetch README content for each repo (slower)

Output Examples

Repository

{
  "type": "repository",
  "rank": 1,
  "owner": "microsoft",
  "name": "typescript",
  "fullName": "microsoft/typescript",
  "url": "https://github.com/microsoft/typescript",
  "description": "TypeScript is a superset of JavaScript",
  "language": "TypeScript",
  "languageColor": "#3178c6",
  "stars": 98500,
  "forks": 12300,
  "starsToday": 456,
  "starsPeriod": "today",
  "builtBy": [
    { "username": "user1", "avatar": "https://..." }
  ],
  "scrapedAt": "2024-01-16T12:00:00.000Z"
}

Developer

{
  "type": "developer",
  "rank": 1,
  "username": "torvalds",
  "displayName": "Linus Torvalds",
  "url": "https://github.com/torvalds",
  "avatar": "https://...",
  "popularRepo": {
    "name": "linux",
    "url": "https://github.com/torvalds/linux",
    "description": "Linux kernel source tree"
  },
  "scrapedAt": "2024-01-16T12:00:00.000Z"
}

Use Cases

• Open Source Intelligence — Track emerging projects and technologies
• Developer Recruiting — Find active contributors in specific languages
• Market Research — Monitor technology trends and adoption
• Content Creation — Weekly trending repos newsletter or blog
• Investment Research — Identify popular developer tools early

How It Works

Scrapes the GitHub Trending page directly. No API key required. Optionally uses the GitHub REST API for README content (unauthenticated, 60 requests/hour limit).

Cost

Uses Pay Per Event pricing. Each scraped item (repository or developer) counts as one result.