GitHub Repository Scraper

Search and extract repository data from GitHub. Get stars, forks, topics, languages, and more from any public repository.

Features

• Search mode - Find repos by keywords, stars, language
• User mode - Get all repos from a specific user/org
• Trending mode - Discover trending repos this week
• Language filter - Filter by programming language
• README extraction - Optionally fetch README content

Search Query Examples

GitHub uses a powerful search syntax:

• machine learning - Search in name/description
• stars:>1000 - Repos with 1000+ stars
• language:python - Python repos only
• topic:react - Repos with React topic
• user:facebook - Repos by Facebook
• created:>2025-01-01 - Created after date
• pushed:>2025-01-01 - Recently updated
• stars:100..500 - Stars in range

Combine queries: language:rust stars:>500 topic:cli

Output Example

{
  "rank": 1,
  "name": "facebook/react",
  "description": "A declarative, efficient, and flexible JavaScript library...",
  "url": "https://github.com/facebook/react",
  "stars": 225000,
  "forks": 46000,
  "watchers": 225000,
  "openIssues": 850,
  "language": "JavaScript",
  "license": "MIT",
  "topics": ["declarative", "frontend", "javascript", "library", "react", "ui"],
  "createdAt": "2013-05-24T16:15:54Z",
  "updatedAt": "2026-01-17T10:00:00Z",
  "owner": "facebook",
  "ownerType": "Organization",
  "isArchived": false,
  "isFork": false
}

Input Parameters

Parameter	Type	Description
mode	string	search, user, or trending
searchQuery	string	GitHub search query
username	string	GitHub username (for user mode)
language	string	Filter by programming language
sortBy	string	Sort by stars, forks, or updated
order	string	desc or asc
maxItems	number	Maximum repos to extract
minStars	number	Minimum stars filter
minForks	number	Minimum forks filter
includeReadme	boolean	Fetch README content

Use Cases

• Tech research - Find popular libraries and tools
• Competitor analysis - Track competitor repos
• Talent sourcing - Find active developers
• Trend monitoring - Discover new technologies
• Dataset building - Create ML training data

Rate Limits

GitHub API limits:

• Without token: 60 requests/hour
• With token: 5,000 requests/hour

The scraper handles rate limits automatically with retries.

Cost

Minimal - uses FREE GitHub API, no browser needed.

---

Built by flowbot.company

Usage with AI (MCP)

Connect to mcp.apify.com and use natural language:

• "Scrape data using Github Scraper"
• "Get results from Github Scraper"
• "Run Github Scraper with default settings"