# Zero-Code RAG Markdown Scraper

**Use case:** 

Instantly scrape developer documentation, blogs, or SPAs into perfect Markdown chunks. Export directly as a ZIP file to feed into your AI Agents and LLMs.

## Input

```json
{
  "startUrls": [
    {
      "url": "https://crawlee.dev"
    }
  ],
  "sitemapUrls": [],
  "exportAsZip": false,
  "exportFailedUrls": true,
  "onlyScrapeUpdatedPages": false,
  "webhookUrl": "",
  "aiApiKey": "",
  "aiApiBaseUrl": "https://api.openai.com/v1",
  "aiModel": "gpt-4o-mini",
  "enableVision": false,
  "customAiPrompt": "",
  "pineconeApiKey": "",
  "pineconeIndexHost": "",
  "customRegexExtractors": [],
  "injectFrontmatter": false,
  "initialCookies": [],
  "useBrowser": false,
  "scrollToBottom": false,
  "waitForSelector": "",
  "clickSelector": "",
  "chunkSize": 1000,
  "chunkOverlap": 200,
  "mustIncludeUrls": [],
  "excludeUrls": [],
  "proxyConfiguration": {
    "useApifyProxy": true
  },
  "maxPagesPerCrawl": 100,
  "maxCrawlDepth": 20,
  "maxRequestRetries": 1,
  "maxConcurrency": 10,
  "stripQueryParameters": true,
  "enableDeduplication": true,
  "removeSelectors": "nav, footer, aside, script, style, noscript, iframe, svg, .cookie-banner, .ads"
}
```

## Output

```json
{
  "url": {
    "label": "URL",
    "format": "string"
  },
  "title": {
    "label": "Page Title",
    "format": "string"
  },
  "text": {
    "label": "Markdown Content",
    "format": "string"
  },
  "aiResponse": {
    "label": "AI Analysis",
    "format": "string"
  },
  "crawledAt": {
    "label": "Crawled At",
    "format": "string"
  }
}
```

## About this Actor

This example demonstrates how to use [RAG Markdown Scraper](https://apify.com/tillzero/rag-markdown-scraper) with a specific input configuration. Visit the [Actor detail page](https://apify.com/tillzero/rag-markdown-scraper) to learn more, explore other use cases, and run it yourself.