Pricing

from $0.10 / 1,000 results

Try for free

Go to Apify Store

GitHub Repo Scraper - Code & Docs to LLM-Ready Text

Try for free

Chat with a repo: turn any GitHub repository into LLM-ready text - README, file tree and source files as clean text with token counts, plus repo metadata and optional issues. Feed a codebase to ChatGPT/Claude or a RAG pipeline. Official GitHub API, no token required. Export JSON, CSV or Markdown.

Pricing

from $0.10 / 1,000 results

Rating

0.0

(0)

Developer

Get Anything

Actor stats

Bookmarked

Total users

Monthly active users

21 hours ago

Last modified

Categories

Developer tools

You can access the GitHub Repo Scraper - Code & Docs to LLM-Ready Text programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "repos": [
12        "apify/apify-sdk-python"
13    ]
14};
15
16// Run the Actor and wait for it to finish
17const run = await client.actor("get_anything/github-repo-scraper").call(input);
18
19// Fetch and print Actor results from the run's dataset (if any)
20console.log('Results from dataset');
21console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
22const { items } = await client.dataset(run.defaultDatasetId).listItems();
23items.forEach((item) => {
24    console.dir(item);
25});
26
27// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

GitHub Repo Scraper - Code & Docs to LLM-Ready Text API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use GitHub Repo Scraper - Code & Docs to LLM-Ready Text API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

GitHub Repo Scraper - Code & Docs to LLM-Ready Text API in Python

GitHub Repo Scraper - Code & Docs to LLM-Ready Text API through CLI

GitHub Repo Scraper - Code & Docs to LLM-Ready Text OpenAPI definition

GitHub Repo Scraper - Code & Docs to LLM-Ready Text API

YouTube Transcript & Subtitles Scraper API

johnvc/YoutubeTranscripts

Scrape YouTube transcripts, subtitles, and captions in bulk, the cheapest pay-per-video YouTube transcript API on Apify. Callable from any MCP client (Claude, Cursor, ChatGPT). Supports YouTube videos, Shorts, and every URL format.

John

3.2K

4.5

(10)

AI Context Scraper

wheat_tourist/ai-context-scraper

AI Context Scraper is a production-grade Apify Actor that gathers high-quality coding context from the Web, GitHub, and StackOverflow for AI agents and RAG systems. It uses NVIDIA Nemotron 3 Super to synthesize documents, code snippets, and patterns into actionable implementation guidance.

Varun Chopra

GitHub Scraper - Repos, Developers & Contact Leads

scrapesage/github-scraper

Scrape GitHub via the official API: search repositories & developers, get full repo metadata, README, languages, topics, stars & activity, plus developer/org profiles and contributor & stargazer leads with emails. Developer lead-gen + monitoring. No browser.

Scrape Sage

GitHub Repo Scraper | 24 Fields, README & Release, No Token

themineworks/github-repo-intelligence

Deep metadata for any public GitHub repository: stars, forks, language breakdown, topics, license, README, contributors count, latest release, commit recency. No token required. MCP ready for AI agents doing repo due diligence.

The Mine Works

GitHub Repository README Scraper

parseforge/github-repo-readme-scraper

Scrape README content from GitHub repositories by search query or direct URL. Returns full Markdown body, rendered text, stars, language, license, and topics for each repo.

ParseForge

Website Content Crawler for AI — Clean Markdown, 4x Cheaper

joyouscam35875/website-content-crawler

Crawl any website and extract clean text/markdown for LLMs, RAG pipelines, vector databases. BFS crawl with depth control, robots.txt support, boilerplate removal. Perfect for feeding AI models. $0.001/page — 4x cheaper than the official Apify crawler.

Ken Digital

GitHub Repository Scraper - Stars, Topics, Trending

logiover/github-repository-scraper

Scrape GitHub repos by search query and export stars, topics, forks & license to CSV/JSON. GitHub data export without an API key - trending repos scraper.

Logiover

Google News Scraper - Articles, Sources & Monitoring

scrapesage/google-news-scraper

Scrape Google News by keyword, topic, top headlines or city. Get real publisher URLs (decoded, not redirect links), source, date, snippet, related coverage and full article text, author & image. Monitor mode returns only new articles. Export JSON, CSV, Excel.

Scrape Sage

Bing Copilot AI Answers API | Microsoft AEO Monitoring

johnvc/bing-copilot-api

Track Bing Copilot AI answers for any query: Microsoft AI-generated answers, structured text blocks, cited sources, and brand mentions as clean JSON. The fourth engine in the AEO suite with Google AI Overview, Naver AI Overview, and Brave AI Mode. Pay per query. MCP-ready for AI agents.

John

5.0

(1)

Site Crawler: Website → Markdown Corpus for LLM/RAG

boxbox10/site-crawler

Crawl a whole website or docs site and get one clean, LLM-ready Markdown + JSON record per page (title, headings, content, links, token count). Built for RAG ingestion and AI knowledge bases.

Marvin Eguilos

PDF Extractor: PDF → Clean Markdown + JSON for LLM/RAG

boxbox10/pdf-extractor

Turn any PDF URL into clean, LLM-ready Markdown + structured JSON (title, metadata, per-page text, page count, word count, token count). Perfect for RAG pipelines, AI agents, and LLM document ingestion.

Marvin Eguilos