Tech Docs to LLM-Ready Markdown

Pricing

$0.50 / 1,000 pages

Tech Docs to LLM-Ready Markdown

Scrapes technical documentation sites (Docusaurus, GitBook, MkDocs, ReadTheDocs) and converts them to clean, structured Markdown for RAG pipelines, LLM training, and AI assistants. Automatically detects documentation framework and removes navigation elements.

Pricing

$0.50 / 1,000 pages

Rating

0.0

(0)

Developer

Dmitry Goncharov

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

17 days ago

Last modified

Categories

Developer tools

You can access the Tech Docs to LLM-Ready Markdown programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

{
  "openapi": "3.0.1",
  "info": {
    "version": "1.0",
    "x-build-id": "iZiHRgtnCDiLwlSrx"
  },
  "servers": [
    {
      "url": "https://api.apify.com/v2"
    }
  ],
  "paths": {
    "/acts/hedelka~tech-docs-scraper/run-sync-get-dataset-items": {
      "post": {
        "operationId": "run-sync-get-dataset-items-hedelka-tech-docs-scraper",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK"
          }
        }
      }
    },
    "/acts/hedelka~tech-docs-scraper/runs": {
      "post": {
        "operationId": "runs-sync-hedelka-tech-docs-scraper",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor and returns information about the initiated run in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK",
            "content": {
              "application/json": {
                "schema": {
                  "$ref": "#/components/schemas/runsResponseSchema"
                }
              }
            }
          }
        }
      }
    },
    "/acts/hedelka~tech-docs-scraper/run-sync": {
      "post": {
        "operationId": "run-sync-hedelka-tech-docs-scraper",
        "x-openai-isConsequential": false,
        "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.",
        "tags": [
          "Run Actor"
        ],
        "requestBody": {
          "required": true,
          "content": {
            "application/json": {
              "schema": {
                "$ref": "#/components/schemas/inputSchema"
              }
            }
          }
        },
        "parameters": [
          {
            "name": "token",
            "in": "query",
            "required": true,
            "schema": {
              "type": "string"
            },
            "description": "Enter your Apify token here"
          }
        ],
        "responses": {
          "200": {
            "description": "OK"
          }
        }
      }
    }
  },
  "components": {
    "schemas": {
      "inputSchema": {
        "type": "object",
        "required": [
          "startUrls"
        ],
        "properties": {
          "preset": {
            "title": "Quick Start Preset",
            "enum": [
              "custom",
              "docusaurus",
              "mkdocs",
              "readthedocs",
              "gitbook",
              "small-docs",
              "large-docs"
            ],
            "type": "string",
            "description": "Pre-configured settings for common documentation frameworks. Select a preset or use 'Custom' for manual configuration.",
            "default": "custom"
          },
          "startUrls": {
            "title": "Start URLs",
            "type": "array",
            "description": "URLs of documentation sites to scrape (e.g., https://docs.example.com)",
            "items": {
              "type": "object",
              "required": [
                "url"
              ],
              "properties": {
                "url": {
                  "type": "string",
                  "title": "URL of a web page",
                  "format": "uri"
                }
              }
            }
          },
          "maxPages": {
            "title": "Max Pages",
            "minimum": 1,
            "maximum": 10000,
            "type": "integer",
            "description": "Maximum number of pages to scrape",
            "default": 100
          },
          "maxDepth": {
            "title": "Max Crawl Depth",
            "minimum": 1,
            "maximum": 50,
            "type": "integer",
            "description": "Maximum link depth to follow from start URLs",
            "default": 10
          },
          "outputFormat": {
            "title": "Output Format",
            "enum": [
              "markdown",
              "html",
              "text"
            ],
            "type": "string",
            "description": "Format of the output content",
            "default": "markdown"
          },
          "enableChunking": {
            "title": "Enable Chunking",
            "type": "boolean",
            "description": "Split content into chunks for RAG embeddings. Creates multiple dataset items per page.",
            "default": false
          },
          "chunkSize": {
            "title": "Chunk Size (characters)",
            "minimum": 500,
            "maximum": 10000,
            "type": "integer",
            "description": "Maximum characters per chunk. Only used when chunking is enabled.",
            "default": 2000
          },
          "exportJsonl": {
            "title": "Export JSONL",
            "type": "boolean",
            "description": "Also save output as JSONL file (1 document per line) for direct import to vector stores.",
            "default": false
          },
          "includeMetadata": {
            "title": "Include Metadata",
            "type": "boolean",
            "description": "Include page metadata (crawl date, word count, char count) in output",
            "default": true
          },
          "removeNavigation": {
            "title": "Remove Navigation",
            "type": "boolean",
            "description": "Remove navigation elements (sidebars, headers, footers)",
            "default": true
          },
          "preserveCodeBlocks": {
            "title": "Preserve Code Blocks",
            "type": "boolean",
            "description": "Preserve code blocks with language syntax highlighting",
            "default": true
          }
        }
      },
      "runsResponseSchema": {
        "type": "object",
        "properties": {
          "data": {
            "type": "object",
            "properties": {
              "id": {
                "type": "string"
              },
              "actId": {
                "type": "string"
              },
              "userId": {
                "type": "string"
              },
              "startedAt": {
                "type": "string",
                "format": "date-time",
                "example": "2025-01-08T00:00:00.000Z"
              },
              "finishedAt": {
                "type": "string",
                "format": "date-time",
                "example": "2025-01-08T00:00:00.000Z"
              },
              "status": {
                "type": "string",
                "example": "READY"
              },
              "meta": {
                "type": "object",
                "properties": {
                  "origin": {
                    "type": "string",
                    "example": "API"
                  },
                  "userAgent": {
                    "type": "string"
                  }
                }
              },
              "stats": {
                "type": "object",
                "properties": {
                  "inputBodyLen": {
                    "type": "integer",
                    "example": 2000
                  },
                  "rebootCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "restartCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "resurrectCount": {
                    "type": "integer",
                    "example": 0
                  },
                  "computeUnits": {
                    "type": "integer",
                    "example": 0
                  }
                }
              },
              "options": {
                "type": "object",
                "properties": {
                  "build": {
                    "type": "string",
                    "example": "latest"
                  },
                  "timeoutSecs": {
                    "type": "integer",
                    "example": 300
                  },
                  "memoryMbytes": {
                    "type": "integer",
                    "example": 1024
                  },
                  "diskMbytes": {
                    "type": "integer",
                    "example": 2048
                  }
                }
              },
              "buildId": {
                "type": "string"
              },
              "defaultKeyValueStoreId": {
                "type": "string"
              },
              "defaultDatasetId": {
                "type": "string"
              },
              "defaultRequestQueueId": {
                "type": "string"
              },
              "buildNumber": {
                "type": "string",
                "example": "1.0.0"
              },
              "containerUrl": {
                "type": "string"
              },
              "usage": {
                "type": "object",
                "properties": {
                  "ACTOR_COMPUTE_UNITS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_WRITES": {
                    "type": "integer",
                    "example": 1
                  },
                  "KEY_VALUE_STORE_LISTS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_INTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_SERPS": {
                    "type": "integer",
                    "example": 0
                  }
                }
              },
              "usageTotalUsd": {
                "type": "number",
                "example": 0.00005
              },
              "usageUsd": {
                "type": "object",
                "properties": {
                  "ACTOR_COMPUTE_UNITS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATASET_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "KEY_VALUE_STORE_WRITES": {
                    "type": "number",
                    "example": 0.00005
                  },
                  "KEY_VALUE_STORE_LISTS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_READS": {
                    "type": "integer",
                    "example": 0
                  },
                  "REQUEST_QUEUE_WRITES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_INTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "DATA_TRANSFER_EXTERNAL_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_RESIDENTIAL_TRANSFER_GBYTES": {
                    "type": "integer",
                    "example": 0
                  },
                  "PROXY_SERPS": {
                    "type": "integer",
                    "example": 0
                  }
                }
              }
            }
          }
        }
      }
    }
  }
}

Tech Docs to Markdown for RAG & LLM OpenAPI definition

OpenAPI is a standard for designing and describing RESTful APIs, allowing developers to define API structure, endpoints, and data formats in a machine-readable way. It simplifies API development, integration, and documentation.

OpenAPI is effective when used with AI agents and GPTs by standardizing how these systems interact with various APIs, for reliable integrations and efficient communication.

By defining machine-readable API specifications, OpenAPI allows AI models like GPTs to understand and use varied data sources, improving accuracy. This accelerates development, reduces errors, and provides context-aware responses, making OpenAPI a core component for AI applications.

You can download the OpenAPI definitions for Tech Docs to LLM-Ready Markdown from the options below:

OpenAPI.json

If you’d like to learn more about how OpenAPI powers GPTs, read our blog post.

You can also check out our other API clients:

Tech Docs to LLM-Ready Markdown API in Python

Tech Docs to LLM-Ready Markdown API in JavaScript

Tech Docs to LLM-Ready Markdown API through CLI

Tech Docs to LLM-Ready Markdown API

Doc To Markdown MCP Server

abotapi/doc-to-markdown-mcp

An MCP server that converts documents to clean Markdown. Convert PDFs, Word docs, Excel spreadsheets, PowerPoints, HTML, images, and more to AI-friendly Markdown format.

AbotAPI

Truth Social Scraper | All-In-One | $12 / mo

fatihtahta/truth-social-scraper-all-in-one

The all-in-one Truth Social scraper. Extract detailed data from profiles, posts, replies, and full comment threads using search queries or direct URLs. This enterprise-grade tool delivers clean, structured data for research and analysis. No cookies needed.

Fatih Tahta

5.0

Zendesk Help Center

canadesk/zendesk

Get all articles from any public Zendesk Help Center. It's fast and costs little.

Canadesk Support

Truth Social Scraper

tri_angle/truth-scraper

Scrape profile info, truths and replies from the Truth social media platform.

Tri⟁angle

229

5.0

Truth Social Scraper

louisdeconinck/truth-social-scraper

The Truth Social Scraper is your go-to tool for extracting data from Truth Social profiles. Ideal for monitoring updates, conducting sentiment analysis, and gathering research data, it tracks engagement metrics like followers and statuses. Easy setup, run, and download in formats like JSON or CSV.

Louis Deconinck

202

5.0

Truthsocial ScrapeBI

scrapebi/truthsocial-apify

Advanced Truth Social Scraper | Extract comprehensive data from Truth Social with enterprise-grade reliability. Get user profiles, posts, followers, following lists, and trending content. Features smart rate limiting, automatic retries, proxy support, and real-time pagination. - powered by ScrapeBI

ScrapeBI

5.0

Zendesk MCP Server Actor

amaranth_nylon/Zendesk-MCP-Server-actor

The Zendesk MCP Server Actor refers to a specialized software component or actor within the Model Context Protocol (MCP) framework, designed to facilitate seamless integration between artificial intelligence (AI) agents and Zendesk's customer support platform.

Yash Kavaiya

RAG Spider - Web to Markdown Crawler for AI Training Data

lenient_grove/RAG-Spider

Enterprise-grade web crawler that converts messy websites into clean, chunked Markdown for AI systems. Uses Mozilla Readability for 95% cleaner extraction than competitors. Outputs RAG-ready data with metadata and token estimates. Perfect for building knowledge bases and training AI chatbots.

Tejas Rawool

5.0

eSIMDB Country Scraper

muhammetakkurtt/esimdb-country-scraper

This Apify actor collects eSIM data plans for specific countries. It collects comprehensive data such as provider information, plan details and pricing from esimdb.com and saves it in the Apify dataset. Users can easily retrieve relevant eSIM data by selecting a country.

Muhammet Akkurt

5.0

DexScreener Realtime Monitor

muhammetakkurtt/dexscreener-realtime-monitor

DexScreener Real-time API via SSE. Stream live data for trending pairs, prices, volume & liquidity on Solana, Base, ETH & 60+ chains. Ultra-fast updates perfect for trading bots, sniper algorithms & DeFi analytics dashboards. Detect new token launches instantly with zero polling latency

Muhammet Akkurt

5.0