Github Repo Markdown Scraper avatar
Github Repo Markdown Scraper

Pricing

$19.00/month + usage

Go to Store
Github Repo Markdown Scraper

Github Repo Markdown Scraper

Developed by

Louis Deconinck

Maintained by Community

Transform GitHub repositories into a single, comprehensive markdown document effortlessly. Our tool streamlines analysis and processing, offering configurable file size limits, pattern filtering, and batch processing. Perfect for LLM AI prompts, it handles large repositories with ease.

5.0 (1)

Pricing

$19.00/month + usage

1

Monthly users

2

Runs succeeded

>99%

Last modified

3 months ago

GitHub Repository Markdown Scraper

This actor scrapes GitHub repositories and converts their contents into markdown format using the gitingest.com service. It's useful for documentation, analysis, or creating searchable content from GitHub repositories.

Features

  • Process multiple GitHub repository URLs
  • Configurable file inclusion/exclusion patterns
  • Adjustable maximum file size limit
  • Converts repository content to markdown format

Input Parameters

  • githubRepoUrls (required): Array of GitHub repository URLs to process
  • patternType (optional): Whether to "include" or "exclude" files matching the pattern (default: "exclude")
  • pattern (optional): Glob pattern for files to include/exclude (e.g., "*.md", "src/")
  • maxFileSizeKb (optional): Maximum file size in kilobytes to include in output (default: 50)

Output

The actor outputs JSON objects with the following structure for each processed repository:

1{
2    "url": "https://github.com/user/repo",
3    "markdownContent": "# Repository Content..."
4}

Example Usage

1{
2    "githubRepoUrls": [
3        "https://github.com/username/repository",
4        "https://github.com/username/another-repo/tree/main"
5    ],
6    "patternType": "include",
7    "pattern": "*.md",
8    "maxFileSizeKb": 100
9}

Pricing

Pricing model

Rental 

To use this Actor, you have to pay a monthly rental fee to the developer. The rent is subtracted from your prepaid usage every month after the free trial period. You also pay for the Apify platform usage.

Free trial

2 hours

Price

$19.00