Pricing

from $0.07 / 1,000 results

Try for free

Go to Apify Store

GitHub Scraper - Repo Code, Docs & Metadata to LLM Text

Try for free

Chat with a repo: turn any GitHub repository into LLM-ready text - README, file tree and source files as clean text with token counts, plus repo metadata and optional issues. Feed a codebase to ChatGPT/Claude or a RAG pipeline. Official GitHub API, no token required. Export JSON, CSV or Markdown.

Pricing

from $0.07 / 1,000 results

Rating

0.0

(0)

Developer

Get Anything

Actor stats

Bookmarked

Total users

Monthly active users

9 hours ago

Last modified

Categories

Developer tools

You can access the GitHub Scraper - Repo Code, Docs & Metadata to LLM Text programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = { "repos": ["apify/apify-sdk-python"] }
9
10# Run the Actor and wait for it to finish
11run = client.actor("get_anything/github-repo-scraper").call(run_input=run_input)
12
13# Fetch and print Actor results from the run's dataset (if there are any)
14print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
15for item in client.dataset(run.default_dataset_id).iterate_items():
16    print(item)
17
18# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

GitHub Scraper - Repository Code & Docs to LLM Text API in Python

The Apify API client for Python is the official library that allows you to use GitHub Scraper - Repo Code, Docs & Metadata to LLM Text API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

GitHub Scraper - Repo Code, Docs & Metadata to LLM Text API in JavaScript

GitHub Scraper - Repo Code, Docs & Metadata to LLM Text API through CLI

GitHub Scraper - Repo Code, Docs & Metadata to LLM Text OpenAPI definition

GitHub Scraper - Repo Code, Docs & Metadata to LLM Text API

Github Repo User Scraper

inquisitive_sarangi/github-repo-scraper

Github Repo User Scraper is simple tool to extract users of a repo(s) like contributors, stargazers & watchers. You can also export listings to JSON/CSV or any other as format.

API Master

Youtube Transcript Scraper

pintostudio/youtube-transcript-scraper

Looking for a reliable way to extract transcripts from YouTube videos? 🎥✨ Look no further! The YouTube-Transcript-Scraper has you covered. 🚀 It effortlessly retrieves transcripts while offering additional valuable insights. Ready to start? Let’s scrape away! 🕵️‍♂️💻

Pinto Studio

27K

3.7

(49)

LinkedIn Profile Scraper + Email (No Cookies)

harvestapi/linkedin-profile-scraper

Extract detailed information from LinkedIn profiles in bulk, including complete work experience, education history, skills and more. No cookies or account required.

HarvestAPI

87K

4.6

(93)

GitHub Scraper

muscular_quadruplet/github-scraper

Scrape GitHub repositories, users, stars, forks. Extract trending repos, developer profiles, code stats. Monitor open source projects, find contributors, analyze tech stacks. No API limits.

Do It

5.0

(1)

Github Repo Markdown Scraper

louisdeconinck/github-repo-markdown-scraper

Transform GitHub repositories into a single, comprehensive markdown document effortlessly. Our tool streamlines analysis and processing, offering configurable file size limits, pattern filtering, and batch processing. Perfect for LLM AI prompts, it handles large repositories with ease.

Louis Deconinck

5.0

(2)

GitHub Profile Scraper

fetch_cat/github-profile-scraper

Extract public GitHub developer profiles from usernames, profile URLs, or user-search queries. Export names, bios, companies, locations, contact links, followers, and optional repository metrics for recruiting, DevRel, sales, and market research.

Fetch Cat

Web Unblocker - Anti-Bot Scraper (Cloudflare, DataDome)

get_anything/web-unblocker

Fetch any URL even behind anti-bot walls (Cloudflare, DataDome, PerimeterX, Akamai, Imperva). Returns HTML plus optional Markdown/text and a screenshot, detects which protection guards the site, and retries via a hardened browser on a fresh residential IP when blocked. No API key.

Get Anything

Llm Ready Documentation Scraper

direct_duty/llm-ready-documentation-scraper

Developers and AI agents need to read documentation (e.g. Stripe Docs, Next.js Docs), but standard scrapers return noisy HTML that includes: navigation bars headers / footers ads / cookie banners This Actor must return pure content-only Markdown, suitable for vectorization and semantic search.

Sean

GitHub API Scraper: Repos & Profiles

andok/github-api-scraper

Extract GitHub repository stats and user profiles via the official REST API in bulk. Dual-mode targets for OSS research and developer enrichment.

Andok

Gitingest: GitHub to LLM Context

gauzy_synthesizer/gitingest-repo-to-llm

Turn any GitHub repository into a single text file optimized for LLMs (ChatGPT, Claude, DeepSeek). Perfect for RAG pipelines, code debugging, and AI context extraction.