# Comprehensive HTML Content Extraction Tool

**Use case:** 

Crawl and extract text content from websites. Ideal for feeding data into AI models and applications. Get the result as HTML or converted to Markdown.

## Input

```json
{
  "startUrls": [
    {
      "url": "https://apify.com/"
    }
  ],
  "crawlerType": "cheerio",
  "includeUrlGlobs": [],
  "excludeUrlGlobs": [],
  "maxCrawlDepth": 20,
  "maxCrawlPages": 9999999,
  "useSitemaps": false,
  "useLlmsTxt": false,
  "respectRobotsTxtFile": false,
  "keepUrlFragments": false,
  "ignoreCanonicalUrl": false,
  "proxyConfiguration": {
    "useApifyProxy": true
  },
  "initialCookies": "***",
  "customHttpHeaders": {},
  "signHttpRequests": false,
  "initialConcurrency": 0,
  "maxConcurrency": 200,
  "requestTimeoutSecs": 60,
  "minFileDownloadSpeedKBps": 128,
  "maxRequestRetries": 3,
  "maxSessionRotations": 3,
  "ignoreHttpsErrors": false,
  "dynamicContentWaitSecs": 10,
  "waitForSelector": "",
  "softWaitForSelector": "",
  "maxScrollHeightPixels": 5000,
  "removeCookieWarnings": true,
  "blockMedia": false,
  "expandIframes": true,
  "clickElementsCssSelector": "[aria-expanded=\"false\"]",
  "pageFunction": "",
  "keepElementsCssSelector": "",
  "removeElementsCssSelector": "nav, footer, script, style, noscript, svg,\n[role=\"alert\"],\n[role=\"banner\"],\n[role=\"dialog\"],\n[role=\"alertdialog\"],\n[role=\"region\"][aria-label*=\"skip\" i],\n[aria-modal=\"true\"]",
  "htmlTransformer": "readableTextIfPossible",
  "readableTextCharThreshold": 100,
  "aggressivePrune": false,
  "debugMode": false,
  "debugLog": false,
  "storeSkippedUrls": false,
  "saveHtml": false,
  "saveHtmlAsFile": true,
  "saveMarkdown": true,
  "saveFiles": true,
  "saveScreenshots": false,
  "maxResults": 9999999,
  "clientSideMinChangePercentage": 15,
  "renderingTypeDetectionPercentage": 10,
  "reuseStoredDetectionResults": false
}
```

## Output

```json
{
  "url": {
    "label": "URL",
    "format": "string"
  },
  "markdown": {
    "label": "Markdown",
    "format": "string"
  }
}
```

## About this Actor

This example demonstrates how to use [Website Content Crawler](https://apify.com/apify/website-content-crawler) with a specific input configuration. Visit the [Actor detail page](https://apify.com/apify/website-content-crawler) to learn more, explore other use cases, and run it yourself.