GitHub Scraper 🐙

Search repositories, pull repo details, list a user/org's repos, and fetch releases or issues — straight from the official GitHub API. No key required, no proxy.

Clean, structured GitHub data from the official REST API: search repos by language, stars and topic; full repo details (stars, forks, watchers, license, topics, activity); every repo for a user or org; releases; and issues. Perfect for OSS/competitor monitoring, release tracking, dependency & security research, dev-trend analysis and talent sourcing.

Uses the official GitHub API — works with no key (60 req/hr). Add a free personal access token for 5,000 req/hr.

---

Five modes

• 🔎 Search repositories — by query, language, min stars and topic; sort by stars/forks/updated.
• 📦 Repo details — full metadata for specific repos (stars, forks, watchers, license, topics, timestamps).
• 👤 User / org repos — every public repo for a user or organization.
• 🏷️ Releases — version history, tags, prerelease flags, publish dates.
• 🐛 Issues — open/closed/all issues (pull requests flagged separately).

Features

• ✅ No API key — official GitHub endpoints; token optional for higher limits.
• ✅ No proxy, no anti-bot — stable official API, very low maintenance.
• ✅ Rich records — stars, forks, watchers, language, topics, license, timestamps.
• ✅ Smart search — combine free text with language/stars/topic qualifiers.
• ✅ Paginated — handles Link-header paging automatically.

---

Input

Field	Description
Mode	search-repos / repo-details / user-repos / releases / issues.
Query / Language / Min stars / Topic	Search filters.
Sort / Order	Search ordering.
Repositories	owner/name list (details, releases, issues).
Users	usernames/orgs (user-repos).
Token	Optional free PAT for 5,000 req/hr.

Example — top Python repos by stars

{
  "mode": "search-repos",
  "language": "python",
  "minStars": 20000,
  "sort": "stars",
  "maxResults": 100
}

Example — releases for specific repos

{
  "mode": "releases",
  "repos": ["pallets/flask", "facebook/react"],
  "maxResults": 50
}

Output

Repo row:

{
  "type": "repo",
  "full_name": "pallets/flask",
  "owner": "pallets",
  "owner_type": "Organization",
  "url": "https://github.com/pallets/flask",
  "language": "Python",
  "stars": 71957,
  "forks": 16903,
  "watchers": 2087,
  "open_issues": 10,
  "topics": ["flask", "jinja", "pallets", "python"],
  "license": "BSD-3-Clause",
  "pushed_at": "2025-01-14T09:00:00Z"
}

Release, issue and user-repo rows carry their own fields (tag/prerelease; number/state/labels/is_pull_request; etc.).

Run it on a schedule

Schedule the Actor to track a competitor's repos, watch for new releases, or monitor star growth over time — then pipe changes to Slack / Google Sheets / a webhook.

Notes & limitations

• Official GitHub API — no key needed (60 req/hr per IP). Adding a free personal access token is recommended — it raises the limit to 5,000 req/hr and avoids the shared per-IP limit on cloud runs. A read-only classic token with no scopes is enough.
• Rate-limit handling: if the limit is reached, the run finishes successfully and returns everything collected so far (with a status message to add a token) — it does not error out.
• Search is capped at 1,000 results by GitHub.
• Public repository/release/issue metadata.
• Data source: GitHub.

---

Keywords

GitHub scraper, GitHub API, GitHub repositories, repo search, GitHub stars, GitHub releases, GitHub issues, open source monitoring, OSS tracking, repo data, developer data, GitHub trending, release tracking, dependency monitoring, GitHub search, code search, GitHub metadata, dev intelligence, star history, GitHub org repos.