GitHub Repository & Trending Scraper

Scrape GitHub repositories, user profiles, organizations, and trending repos. Search by keyword, filter by language and stars, or track what's trending daily/weekly/monthly. Priced at $0.50 per 1,000 results.

What it scrapes

• Repository name, description, and topics
• Stars, forks, open issues, and watchers
• Primary language and language breakdown
• License, creation date, and last update
• README content
• User/org profile: name, bio, follower count, public repo count, company, location
• Top contributors (optional)

Sample output (repository)

{
  "full_name": "openai/whisper",
  "description": "Robust Speech Recognition via Large-Scale Weak Supervision",
  "url": "https://github.com/openai/whisper",
  "stars": 68000,
  "forks": 7900,
  "open_issues": 1400,
  "watchers": 68000,
  "language": "Python",
  "topics": ["speech-recognition", "transformer", "whisper"],
  "license": "MIT",
  "created_at": "2022-09-16",
  "updated_at": "2024-01-15",
  "is_fork": false,
  "homepage": "https://openai.com",
  "readme": "# Whisper\n..."
}

Input

Search repositories

{
  "scrapeType": "search",
  "queries": ["machine learning python"],
  "resultsPerQuery": 30,
  "sort": "stars",
  "language": "python",
  "minStars": 1000
}

User/org profile

{
  "scrapeType": "user",
  "queries": ["openai", "microsoft", "torvalds"]
}

Trending repos

{
  "scrapeType": "trending",
  "queries": ["python", "javascript"],
  "since": "weekly"
}

Single repository

{
  "scrapeType": "repo",
  "queries": ["openai/whisper", "facebook/react"],
  "includeContributors": true
}

Input fields

Field	Type	Default	Description
scrapeType	string	search	search, user, repo, trending
queries	string[]	—	Keywords / usernames / owner/repo paths / languages
resultsPerQuery	integer	30	Max repos per query (up to 1,000)
sort	string	stars	stars, forks, updated, help-wanted-issues, best-match
language	string	—	Filter by programming language
minStars	integer	0	Minimum star count filter
since	string	daily	Trending timeframe: daily, weekly, monthly
includeContributors	boolean	false	Fetch top 10 contributors per repo
githubToken	string	—	Personal access token for higher rate limits (5,000/hr vs 60/hr)

Use cases

• Tech landscape research: find top repos in any language or topic
• Competitor intelligence: track stars and forks over time
• Developer outreach: find contributors to relevant open source projects
• Trend monitoring: daily trending to spot emerging tools
• Portfolio analysis: bulk profile data for GitHub users

Notes

• Without a token: 60 requests/hour (fine for small runs)
• With a GitHub token: 5,000 requests/hour — required for large queries
• Trending scrapes GitHub's public trending page (no API needed)
• README content available in repo mode

Pricing

$0.50 per 1,000 results — GitHub public data, no enterprise API needed.