# GitHub Repository & Developer Scraper — Stars, Tech Stacks & (`spotless_studios/github-repos-scraper`) Actor

Scrape GitHub repositories, developers, stargazers, forks, topics, licenses, and commit activity. Advanced search by stars, programming language, topic tags, and activity dates.

- **URL**: https://apify.com/spotless_studios/github-repos-scraper.md
- **Developed by:** [Spotless Studios](https://apify.com/spotless_studios) (community)
- **Categories:** Developer tools, Lead generation
- **Security:** Limited permissions
- **Stats:** 2 total users, 1 monthly users, 100.0% runs succeeded, 0 bookmarks
- **User rating**: No ratings yet

## Pricing

from $2.00 / 1,000 github repository extracteds

This Actor is paid per event. You are not charged for the Apify platform usage, but only a fixed price for specific events.

Learn more: https://docs.apify.com/actors/running/actors-in-store.md#pay-per-event

## What's an Apify Actor?

An Actor is a serverless cloud program that runs on the Apify platform. It has two run modes.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.

Apify vocabulary and the platform model are defined once, in the agent quickstart at https://apify.com/agents.md.

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.

Do not guess an integration path. Every one of them is in the agent quickstart at https://apify.com/agents.md: the Apify MCP server, Agent Skills with the Apify CLI, the JavaScript and Python clients, the REST API, and the account-free path for an agent with no human to sign in. It also carries the rule on stating cost before the first paid run.

For examples already wired to this Actor's own input schema, see the [API](#api) section below.

Each client library has reference documentation the quickstart does not restate: [JavaScript/TypeScript](https://docs.apify.com/api/client/js/docs.md) (`npm install apify-client`) and [Python](https://docs.apify.com/api/client/python/docs.md) (`pip install apify-client`).

# README

## GitHub Repository & Developer Intelligence Scraper

Extract structured repository metrics, developer profiles, star velocity, fork counts, licenses, and topic tags from GitHub via resilient search APIs.

### Features

- **Rich Metadata Extraction**: Scrapes repository full name, owner, description, stargazers count, forks, open issues, primary language, topics, license, default branch, and commit activity.
- **Advanced Filtering**: Filter by programming language, topic tags, minimum/maximum stars, minimum forks, pushed/commit activity date cutoffs, and keyword inclusion/exclusion.
- **Monitoring & Alert Mode**: Enable `onlyNewItems` with a `stateKey` to run on a schedule and only receive alerts when new repos matching your criteria hit GitHub.
- **Customizable Output Presets**: Choose `full` (all fields), `lean` (lightweight), or `contacts` (repo + owner handle and avatar).
- **Optional Personal Access Token**: Add a GitHub PAT to raise rate limits to 5,000 requests/hour (unauthenticated requests supported out of the box).

### Input Parameters

| Parameter | Type | Default | Description |
|---|---|---|---|
| `searchQuery` | String | `"ai agent"` | Free-text keywords or GitHub qualifiers |
| `language` | String | `""` | Programming language filter (e.g. `typescript`, `python`) |
| `topic` | String | `""` | Filter by topic tag (e.g. `llm`, `automation`, `devtools`) |
| `minStars` | Integer | `0` | Minimum stargazers threshold |
| `minForks` | Integer | `0` | Minimum forks threshold |
| `pushedAfter` | String | `""` | Filter for repos with recent commits (YYYY-MM-DD) |
| `sortBy` | String | `"stars"` | `stars`, `forks`, `updated`, or `help-wanted-issues` |
| `repoNames` | Array | `[]` | Explicit list of repos (e.g. `["facebook/react"]`) |
| `maxResults` | Integer | `100` | Max repositories to extract |
| `onlyNewItems`| Boolean | `false` | Only emit new repositories discovered since last run |
| `outputPreset`| String | `"full"` | `full`, `lean`, or `contacts` |

### Output Example

```json
{
  "repoId": "852802611",
  "fullName": "spotless-studios/ai-agent-kit",
  "name": "ai-agent-kit",
  "ownerLogin": "spotless-studios",
  "ownerType": "Organization",
  "htmlUrl": "https://github.com/spotless-studios/ai-agent-kit",
  "description": "Production toolkit for building autonomous agents with TypeScript",
  "homepage": "https://spotless.dev",
  "language": "TypeScript",
  "stargazersCount": 4520,
  "forksCount": 380,
  "openIssuesCount": 14,
  "licenseName": "MIT License",
  "topics": ["ai", "agents", "typescript", "automation"],
  "isArchived": false,
  "pushedAt": "2026-10-26T18:30:00.000Z",
  "scrapedAt": "2026-10-27T12:00:00.000Z"
}
```

***

### More from Spotless Studios

**[All actors on Apify](https://apify.com/spotless_studios)** · Support: spotless.studios.info@gmail.com

| Actor | Best for |
|-------|----------|
| [SLED Government Bids](https://apify.com/spotless_studios/sled-procurement-scraper) | Daily US gov RFP / bid alerts |
| [Webflow Experts](https://apify.com/spotless_studios/webflow-experts-scraper) | Webflow agency & freelancer leads |
| [Stripe Partners](https://apify.com/spotless_studios/stripe-partners-scraper) | Stripe implementation partner lists |
| [UK Planning Applications](https://apify.com/spotless_studios/uk-planning-applications-scraper) | UK planning leads + agent contacts |
| [Product Hunt](https://apify.com/spotless_studios/product-hunt-scraper) | Every PH launch + makers / websites |
| [Duunitori Jobs](https://apify.com/spotless_studios/duunitori-jobs-scraper) | Finland job listings |
| [Clutch Agencies](https://apify.com/spotless_studios/clutch-agencies-scraper) | Clutch agency prospecting |
| [Skool Communities](https://apify.com/spotless_studios/skool-communities-scraper) | Skool community & creator leads |

# Actor input Schema

## `searchQuery` (type: `string`):

Keywords or GitHub search qualifiers (e.g. 'ai agent', 'mcp server', 'fastapi microservices').

## `searchQueries` (type: `array`):

Optional list of multiple search queries to run sequentially in a single job.

## `language` (type: `string`):

Filter by primary language (e.g. 'typescript', 'python', 'rust', 'go').

## `topic` (type: `string`):

Filter repositories tagged with a specific topic (e.g. 'llm', 'automation', 'developer-tools').

## `owner` (type: `string`):

Filter repositories owned by a specific GitHub user or organization (e.g. 'vercel', 'microsoft', 'anthropics').

## `license` (type: `string`):

Filter by SPDX license key (e.g. 'mit', 'apache-2.0', 'gpl-3.0', 'bsd-3-clause').

## `minStars` (type: `integer`):

Minimum number of stars (e.g. 50, 500, 1000).

## `maxStars` (type: `integer`):

Maximum number of stars (useful for finding emerging repos).

## `minForks` (type: `integer`):

Minimum number of forks.

## `maxForks` (type: `integer`):

Maximum number of forks.

## `createdAfter` (type: `string`):

Only return repos created after this date (YYYY-MM-DD, ISO, or relative like '30 days' / '6 months').

## `pushedAfter` (type: `string`):

Only return repos with commits after this date (YYYY-MM-DD, ISO, or relative like '14 days').

## `includeForks` (type: `boolean`):

Include forked repositories in results.

## `includeArchived` (type: `boolean`):

Keep archived / read-only repositories.

## `sortBy` (type: `string`):

Sort field for repository discovery.

## `sortOrder` (type: `string`):

Descending or ascending order.

## `repoNames` (type: `array`):

Scrape specific repositories directly in 'owner/repo' format or full GitHub URLs (e.g. 'facebook/react', 'https://github.com/vercel/next.js').

## `includeOwnerDetails` (type: `boolean`):

Fetch each repository owner's profile to enrich records with ownerName, ownerEmail, ownerCompany, ownerBlog, ownerLocation, ownerBio, ownerTwitter, and ownerFollowers.

## `githubToken` (type: `string`):

Optional GitHub PAT to increase API rate limits from 60 req/hr to 5,000 req/hr.

## `includeKeywords` (type: `array`):

Keep only repositories matching these keywords or /regex/ in name, description, topics, or owner.

## `excludeKeywords` (type: `array`):

Skip repositories matching any of these keywords or /regex/.

## `keywordMatch` (type: `string`):

Require any or all includeKeywords to match.

## `onlyNewItems` (type: `boolean`):

Remember seen repository IDs across runs and emit only newly discovered repositories.

## `stateKey` (type: `string`):

Separate state key per saved search or schedule.

## `maxResults` (type: `integer`):

Maximum number of repositories to save.

## `outputPreset` (type: `string`):

Choose full record, lean summary, or contacts & links only.

## `outputFields` (type: `array`):

Keep only these specific fields in each saved record.

## `excludeFields` (type: `array`):

Remove specific fields from each saved record.

## `includeEmptyFields` (type: `boolean`):

When disabled, strips null and empty values from each saved record.

## `requiredFields` (type: `array`):

Only save records where every listed field has a non-empty value (e.g. homepage, ownerEmail).

## `maxPages` (type: `integer`):

Maximum search pages per query (100 repos per page, GitHub search returns up to 10 pages per query).

## `maxConcurrency` (type: `integer`):

Parallel requests when fetching direct repositories.

## `maxRequestRetries` (type: `integer`):

Retries per failed or rate-limited HTTP request.

## `requestTimeoutSecs` (type: `integer`):

Timeout per HTTP request.

## `proxyConfiguration` (type: `object`):

Optional proxy settings. Direct works first; auto-escalates on rate limits.

## `proxyEscalation` (type: `boolean`):

Automatically step up from direct to Apify datacenter/residential proxies if GitHub rate-limits the IP.

## Actor input object example

```json
{
  "searchQuery": "ai agent",
  "includeForks": false,
  "includeArchived": true,
  "sortBy": "stars",
  "sortOrder": "desc",
  "includeOwnerDetails": false,
  "keywordMatch": "any",
  "onlyNewItems": false,
  "stateKey": "default",
  "maxResults": 50,
  "outputPreset": "full",
  "includeEmptyFields": true,
  "maxPages": 10,
  "maxConcurrency": 4,
  "maxRequestRetries": 3,
  "requestTimeoutSecs": 30,
  "proxyConfiguration": {
    "useApifyProxy": false
  },
  "proxyEscalation": true
}
```

# Actor output Schema

## `items` (type: `string`):

Scrape GitHub repositories, developers, stargazers, forks, topics, licenses, and commit activity. Advanced search by stars, programming language, topic tags, and activity dates.

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "searchQuery": "ai agent",
    "maxResults": 50,
    "proxyConfiguration": {
        "useApifyProxy": false
    }
};

// Run the Actor and wait for it to finish
const run = await client.actor("spotless_studios/github-repos-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "searchQuery": "ai agent",
    "maxResults": 50,
    "proxyConfiguration": { "useApifyProxy": False },
}

# Run the Actor and wait for it to finish
run = client.actor("spotless_studios/github-repos-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
for item in client.dataset(run.default_dataset_id).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "searchQuery": "ai agent",
  "maxResults": 50,
  "proxyConfiguration": {
    "useApifyProxy": false
  }
}' |
apify call spotless_studios/github-repos-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "type": "http",
            "url": "https://mcp.apify.com/?tools=fetch-actor-details,spotless_studios/github-repos-scraper"
        }
    }
}
```

The hosted server signs you in with OAuth on first connect, so no API token belongs in this config. Clients without OAuth support can send an `Authorization: Bearer <APIFY_API_TOKEN>` header instead, using a token from API & Integrations in Apify Console (https://console.apify.com/settings/integrations).

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/actors/sqalDOFTujueAficA/builds/X6fbxV3BmT8vX8aFj/openapi.json