# GitHub Repositories Scraper (`exuberant_volley/github-repos-scraper`) Actor Search public GitHub repositories and scrape clean structured data — stars, forks, language, topics, license, open issues, homepage and timestamps — via the official GitHub REST search API. No token needed, no owner personal data. - **URL**: https://apify.com/exuberant\_volley/github-repos-scraper.md - **Developed by:** [ScrapeForge](https://apify.com/exuberant_volley) (community) - **Categories:** Developer tools, Automation - **Stats:** 2 total users, 1 monthly users, 0.0% runs succeeded, 0 bookmarks - **User rating**: No ratings yet ## Pricing Pay per usage This Actor is paid per platform usage. The Actor is free to use, and you only pay for the Apify platform usage, which gets cheaper the higher subscription plan you have. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-usage ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## GitHub Repository Scraper — Stars, Forks & Repo Data by Search Query **Launch pricing: this actor currently adds no fee — run it on your Apify free-plan credits. Try it, bookmark it, wire it into your stack.** A **GitHub repository scraper** built on the official REST search API: **scrape GitHub repositories** by any search query — with full qualifier support (`language:`, `stars:>`, `topic:`) — and get stars, forks, language, topics, license, open issues and timestamps as clean JSON. It works as a **GitHub stars scraper** for traction tracking and as a keyless **GitHub search API scraper** for **GitHub repo data extraction** — no token, no owner personal data. > Official API, zero setup: repo intel in one run, sorted by stars, forks, freshness or relevance. ### Who uses this - **DevRel & dev-tool marketers** — track competitor repos' star/fork growth and release activity. - **OSS researchers & tech scouts** — map an ecosystem: who leads a topic, what's rising, what's abandoned (`isArchived`). - **Engineering leads** — shortlist libraries by license, open-issue load and last-push freshness before adopting. - **Data & AI teams** — structured repo metadata for trend models and training corpora. Want the discussion layer on top of the code layer? The [Hacker News Scraper](https://apify.com/exuberant_volley/hackernews-scraper) captures what devs are actually talking about. ### How it works The actor pages through GitHub's official `/search/repositories` endpoint with your query and sort order, deduplicates by repo id, and maps each hit to a flat record. The repository owner object (login, avatar, profile URL) is intentionally **excluded** — `fullName` is the stable identifier. Zero-result runs and all-requests-failed runs **fail loudly instead of succeeding empty**. ### Output One record per repository: ```json { "id": 21872392, "fullName": "josephmisiti/awesome-machine-learning", "name": "awesome-machine-learning", "description": "A curated list of awesome Machine Learning frameworks, libraries and software.", "stars": 73457, "forks": 15534, "openIssues": 21, "language": "Python", "topics": [], "license": null, "isFork": false, "isArchived": false, "homepage": null, "htmlUrl": "https://github.com/josephmisiti/awesome-machine-learning", "createdAt": "2014-07-15T19:11:19Z", "updatedAt": "2026-07-15T09:17:52Z", "pushedAt": "2026-07-14T13:00:59Z", "scrapedAt": "2026-07-15T09:34:39.938Z" } ```` - `pushedAt` is the real "is it alive" signal (last code push); `updatedAt` also moves on stars/metadata. - `license` is the SPDX id (`MIT`, `Apache-2.0`, …) or `null`. ### Input | Field | Default | Description | |---|---|---| | `query` | `machine learning` | GitHub search query; supports qualifiers like `language:python stars:>1000` | | `perPage` | `50` | Results per API page (max 100) | | `maxItems` | — | Total cap (GitHub search returns at most 1000 per query); empty = one page | | `sort` | `best-match` | `best-match`, `stars`, `forks` or `updated` | **The default run needs no configuration** — an empty input searches `machine learning`. ### Reliability & limits - **Keyless rate limit**: unauthenticated GitHub search allows ~60 requests/hour. The actor stops paging gracefully on `403`/`429` and fails loudly only if nothing at all was fetched. - GitHub caps any search at **1000 results** — segment big sweeps with qualifiers (`stars:1000..5000`, `created:>2025-01-01`). - Search index freshness is GitHub's own (minutes behind live). ### Paste this output into… - **Google Sheets** — `=IMPORTDATA("https://api.apify.com/v2/acts/exuberant_volley~github-repos-scraper/runs/last/dataset/items?format=csv&clean=1&token=YOUR_TOKEN")` for a live repo-watchlist sheet. - **Make / n8n** — schedule weekly, fetch `.../runs/last/dataset/items`, and diff `stars` against last week's snapshot to alert on breakout repos. - **Adoption shortlist (eng leads)** — run `your-topic language:typescript stars:>500`, then filter `isArchived = false` and sort by `pushedAt` — the top rows are the safe bets. ### ScrapeForge free data suite One publisher, fourteen plug-and-play datasets — all currently free to run: | Actor | What it delivers | | |---|---|---| | [Executive Changes Tracker](https://apify.com/exuberant_volley/executive-changes-scraper) | New CEO/CFO/board moves from SEC 8-Ks + official newswires — source-cited B2B trigger leads | [run it next →](https://apify.com/exuberant_volley/executive-changes-scraper) | | [IKEA Product Scraper](https://apify.com/exuberant_volley/ikea-product-scraper) | Names, prices, ratings and images from any IKEA search or category page | [run it next →](https://apify.com/exuberant_volley/ikea-product-scraper) | | [Shopify Store Scraper](https://apify.com/exuberant_volley/shopify-store-scraper) | Any Shopify store's full catalog — variants, SKUs, prices — via products.json | [run it next →](https://apify.com/exuberant_volley/shopify-store-scraper) | | [App Store Apps Scraper](https://apify.com/exuberant_volley/app-store-apps-scraper) | App rankings, ratings, prices and metadata by keyword, any country | [run it next →](https://apify.com/exuberant_volley/app-store-apps-scraper) | | [Remote Jobs Scraper](https://apify.com/exuberant_volley/remote-jobs-scraper) | Live remote listings from RemoteOK + Remotive, keyword-filtered | [run it next →](https://apify.com/exuberant_volley/remote-jobs-scraper) | | [CoinGecko Market Scraper](https://apify.com/exuberant_volley/coingecko-market-scraper) | Top-coin prices, market caps and 24h moves — keyless | [run it next →](https://apify.com/exuberant_volley/coingecko-market-scraper) | | [GitHub Repositories Scraper](https://apify.com/exuberant_volley/github-repos-scraper) | Repo search with stars, forks, topics and licenses | [run it next →](https://apify.com/exuberant_volley/github-repos-scraper) | | [Hacker News Scraper](https://apify.com/exuberant_volley/hackernews-scraper) | Top/New/Best HN stories with scores and comment counts | [run it next →](https://apify.com/exuberant_volley/hackernews-scraper) | | [Wikipedia Scraper](https://apify.com/exuberant_volley/wikipedia-scraper) | Article summaries, images and URLs in any language — RAG-ready | [run it next →](https://apify.com/exuberant_volley/wikipedia-scraper) | | [SEC EDGAR Filings Scraper](https://apify.com/exuberant_volley/sec-edgar-filings-scraper) | Any US public company's filing history by ticker | [run it next →](https://apify.com/exuberant_volley/sec-edgar-filings-scraper) | | [Open-Meteo Weather Scraper](https://apify.com/exuberant_volley/open-meteo-weather-scraper) | 16-day daily forecast for any coordinates — temps, rain, wind — keyless | [run it next →](https://apify.com/exuberant_volley/open-meteo-weather-scraper) | | [arXiv Papers Scraper](https://apify.com/exuberant_volley/arxiv-papers-scraper) | Research papers by topic — abstracts, categories, PDF links, newest-first sort | [run it next →](https://apify.com/exuberant_volley/arxiv-papers-scraper) | | [NVD CVE Scraper](https://apify.com/exuberant_volley/nvd-cve-scraper) | Fresh CVEs with CVSS severity, CWE ids and CISA known-exploited flags | [run it next →](https://apify.com/exuberant_volley/nvd-cve-scraper) | | [npm Registry Scraper](https://apify.com/exuberant_volley/npm-registry-scraper) | npm package vitals — latest version, license, weekly downloads, dependency count | [run it next →](https://apify.com/exuberant_volley/npm-registry-scraper) | ### Compliance - **No personal data** — repo catalog data only, GDPR-safe. The owner object (login, avatar, profile URLs) is intentionally excluded. - **Official API underneath** — GitHub REST search; no HTML parsing, no logins. - Records live only in your run's dataset; the actor keeps nothing beyond it. # Actor input Schema ## `query` (type: `string`): GitHub repository search query. Supports GitHub search qualifiers, e.g. "machine learning language:python stars:>1000". ## `perPage` (type: `integer`): Results requested per API page (max 100). ## `maxItems` (type: `integer`): Stop after this many repositories. GitHub search returns at most 1000 results per query. Leave empty to fetch a single page of perPage results. ## `sort` (type: `string`): How to sort results. "best match" is GitHub's default relevance ranking. ## Actor input object example ```json { "query": "machine learning", "perPage": 50, "sort": "best-match" } ``` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = { "query": "machine learning", "perPage": 50 }; // Run the Actor and wait for it to finish const run = await client.actor("exuberant_volley/github-repos-scraper").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = { "query": "machine learning", "perPage": 50, } # Run the Actor and wait for it to finish run = client.actor("exuberant_volley/github-repos-scraper").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{ "query": "machine learning", "perPage": 50 }' | apify call exuberant_volley/github-repos-scraper --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=exuberant_volley/github-repos-scraper", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "GitHub Repositories Scraper", "description": "Search public GitHub repositories and scrape clean structured data — stars, forks, language, topics, license, open issues, homepage and timestamps — via the official GitHub REST search API. No token needed, no owner personal data.", "version": "0.1", "x-build-id": "wRe1rKooLqKal0bqA" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/exuberant_volley~github-repos-scraper/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-exuberant_volley-github-repos-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/exuberant_volley~github-repos-scraper/runs": { "post": { "operationId": "runs-sync-exuberant_volley-github-repos-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/exuberant_volley~github-repos-scraper/run-sync": { "post": { "operationId": "run-sync-exuberant_volley-github-repos-scraper", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "query" ], "properties": { "query": { "title": "Search query", "type": "string", "description": "GitHub repository search query. Supports GitHub search qualifiers, e.g. \"machine learning language:python stars:>1000\".", "default": "machine learning" }, "perPage": { "title": "Results per page", "minimum": 1, "maximum": 100, "type": "integer", "description": "Results requested per API page (max 100).", "default": 50 }, "maxItems": { "title": "Max repositories", "minimum": 1, "type": "integer", "description": "Stop after this many repositories. GitHub search returns at most 1000 results per query. Leave empty to fetch a single page of perPage results." }, "sort": { "title": "Sort by", "enum": [ "best-match", "stars", "forks", "updated" ], "type": "string", "description": "How to sort results. \"best match\" is GitHub's default relevance ranking.", "default": "best-match" } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```