GitHub Repository Scraper

Extract repository data from GitHub including stars, forks, languages, and trending projects. No API key required for public repositories.

Features

• Repository Search: Search by keywords, topics, or description
• Language Filtering: Filter by programming language (Python, JavaScript, Go, Rust, etc.)
• Sorting Options: Sort by stars, forks, creation date, or last updated
• Trending Repos: Get most starred repositories globally or by language
• Complete Metadata: Stars, forks, issues, license, topics, and more

Input Parameters

Parameter	Type	Required	Default	Description
searchQuery	string	No	-	Search term (e.g., 'machine learning')
language	string	No	-	Filter by language (e.g., 'Python')
maxResults	integer	No	30	Max results (1-100)
sort	string	No	'stars'	Sort by: stars, forks, updated, created
order	string	No	'desc'	Order: desc (high-low) or asc

Search Examples

Most starred Python repositories:

{
  "language": "Python",
  "sort": "stars",
  "maxResults": 50
}

Search for machine learning projects:

{
  "searchQuery": "machine learning",
  "sort": "stars",
  "maxResults": 30
}

Trending JavaScript repositories:

{
  "language": "JavaScript",
  "sort": "updated",
  "order": "desc",
  "maxResults": 20
}

Output Schema

{
  "repositoryId": 132750724,
  "name": "build-your-own-x",
  "fullName": "codecrafters-io/build-your-own-x",
  "owner": "codecrafters-io",
  "ownerType": "Organization",
  "description": "Master programming by recreating your favorite technologies...",
  "url": "https://github.com/codecrafters-io/build-your-own-x",
  "stars": 465969,
  "forks": 43729,
  "openIssues": 474,
  "language": "Markdown",
  "license": "MIT License",
  "topics": ["awesome-list", "programming", "tutorial"],
  "createdAt": "2018-05-09T12:03:18Z",
  "updatedAt": "2026-02-14T23:37:03Z",
  "pushedAt": "2025-12-26T19:40:39Z",
  "sizeKB": 1055,
  "defaultBranch": "master",
  "isFork": false,
  "isArchived": false,
  "hasWiki": false,
  "hasPages": false,
  "hasDiscussions": false,
  "homepage": "https://codecrafters.io"
}

Use Cases

• Market Research: Analyze popular technologies and frameworks
• Competitive Analysis: Track competitor open-source projects
• Developer Recruitment: Identify trending projects and active contributors
• Technology Trends: Monitor which languages and tools are gaining traction
• Portfolio Building: Discover projects for learning and inspiration

Pricing

• Free tier: 100 results
• Paid tier: $0.35 per 100 results ($3.50 per 1,000)

Rate Limits

This scraper uses the GitHub public API with the following limits:

• 10 requests per minute for unauthenticated requests
• Results are cached to optimize performance

Notes

• Only extracts public repository data
• No authentication required
• Data is read-only from GitHub's public API
• Subject to GitHub's Terms of Service

Support

Built by Ruby 🦞 — 24/7 agent support.