# Website SEO Auditor (`crazydev.in/website-seo-auditor`) Actor Crawl any website and get a full SEO audit: broken links, missing meta, H1 issues, thin content, duplicate titles, page speed, canonical, noindex, OG tags and schema. Exports a formatted Excel report. Optional AI report via OpenAI or Gemini. - **URL**: https://apify.com/crazydev.in/website-seo-auditor.md - **Developed by:** [Crazydev](https://apify.com/crazydev.in) (community) - **Categories:** SEO tools, Other - **Stats:** 2 total users, 0 monthly users, 100.0% runs succeeded, NaN bookmarks - **User rating**: 5.00 out of 5 stars ## Pricing from $0.01 / 1,000 results This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage. Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event ## What's an Apify Actor? Actors are a software tools running on the Apify platform, for all kinds of web data extraction and automation use cases. In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours, and optionally produces a well-defined JSON output, datasets with results, or files in key-value store. In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server. Actors are written with capital "A". ## How to integrate an Actor? If asked about integration, you help developers integrate Actors into their projects. You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready. The best way to integrate Actors is as follows. In JavaScript/TypeScript projects, use official [JavaScript/TypeScript client](https://docs.apify.com/api/client/js.md): ```bash npm install apify-client ``` In Python projects, use official [Python client library](https://docs.apify.com/api/client/python.md): ```bash pip install apify-client ``` In shell scripts, use [Apify CLI](https://docs.apify.com/cli/docs.md): ````bash # MacOS / Linux curl -fsSL https://apify.com/install-cli.sh | bash # Windows irm https://apify.com/install-cli.ps1 | iex ```bash In AI frameworks, you might use the [Apify MCP server](https://docs.apify.com/platform/integrations/mcp.md). If your project is in a different language, use the [REST API](https://docs.apify.com/api/v2.md). For usage examples, see the [API](#api) section below. For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt). # README ## SEO Auditor — Crawl, Broken Links, Meta & AI Report Crawl any website and get a complete SEO audit in seconds. Checks broken links, missing or duplicate titles, meta descriptions, H1 issues, thin content, page speed, canonical tags, noindex pages, Open Graph, and structured data (JSON-LD schema) — all exported into a clean, multi-sheet **Excel file** you can hand straight to a client. Optionally, turn on the **AI Report** to get a written, actionable audit generated by OpenAI (GPT-4.1, GPT-4o) or Google Gemini — no extra setup needed, just paste your API key. --- ### What You Get | Output | Where to find it | |---|---| | Per-page SEO data (all fields) | Dataset → Table / JSON / CSV | | Summary stats | Key-Value Store → `SUMMARY` | | Broken links list | Key-Value Store → `BROKEN_LINKS` | | Excel audit report (13 sheets) | Key-Value Store → `audit-report.xlsx` → Download | | AI-written SEO report (optional) | Key-Value Store → `AI_REPORT` | --- ### Excel Sheets Select only the sheets you need — or leave blank to get all 13: | Sheet | What it contains | |---|---| | Summary | Site-wide stats at a glance | | All Pages | Every crawled URL with full SEO fields | | Broken Links | 4xx/5xx URLs with source page and anchor text | | Duplicate Titles | Pages sharing the same title tag | | Duplicate Meta Descriptions | Pages sharing the same meta description | | Meta Issues | Missing, too short, or too long titles/descriptions | | H1 Issues | Missing H1 or multiple H1 tags | | Thin Content | Pages with fewer than 300 words | | Images Missing Alt | Images without alt text | | Canonicalization | Pages missing a canonical tag | | NoIndex Pages | Pages with `noindex` in robots meta | | Schema & OG Tags | Open Graph and JSON-LD schema presence | | Page Speed | Load times per page | --- ### Input Fields | Field | Description | Default | |---|---|---| | **Website URL** | Full URL to audit (e.g. `https://example.com`) | — (required) | | **Max Pages to Crawl** | Stop after this many pages | 50 | | **Crawl Whole Website** | `true` = crawl entire site, `false` = single page only | true | | **Excel Sheets to Include** | Pick sheets you want; leave empty for all | all | | **Generate AI SEO Report** | Write a detailed AI audit (needs an API key) | false | | **OpenAI API Key** | Your OpenAI key — leave blank to use Gemini | — | | **Gemini API Key** | Your Google Gemini key — used if no OpenAI key | — | | **OpenAI Model** | `gpt-4.1-mini` (fast/cheap) or `gpt-4.1` (best) | gpt-4.1-mini | | **Gemini Model** | `gemini-2.0-flash` (fast/cheap) or `gemini-2.5-pro` (best) | gemini-2.0-flash | > API keys are marked **secret** — Apify never exposes them in logs or UI. --- ### How to Use 1. Enter the website URL. 2. Set **Max Pages** (start with 50 for a quick test). 3. Pick which **Excel Sheets** you want, or leave blank for all. 4. *(Optional)* Toggle **Generate AI SEO Report** and paste an OpenAI or Gemini API key. 5. Click **Start** and wait for the run to finish. 6. Go to **Storage → Key-Value Store** and download `audit-report.xlsx`. --- ### Notes - The crawler only follows links on the **same domain** — it will not leave the site. - Sites with broken or expired SSL certificates are handled automatically (HTTP fallback). - The AI report is generated from the crawl data — no extra browsing is done. - API keys for OpenAI / Gemini are **never stored** — they are used only during the run. # Actor input Schema ## `startUrl` (type: `string`): Full URL of the website to audit (e.g. https://crazydev.in/). ## `maxPages` (type: `integer`): Maximum number of HTML pages to visit. Ignored when followLinks is false. ## `followLinks` (type: `boolean`): true → crawl the entire site up to maxPages. false → audit only the single URL. ## `excelSheets` (type: `array`): Tick the sheets you want in the Excel file. Leave all unticked to get every sheet. ## `generateAiReport` (type: `boolean`): Use OpenAI or Gemini to write a detailed, actionable audit. Requires an API key below. ## `openaiApiKey` (type: `string`): Your OpenAI API key for AI report generation. Leave blank to use Gemini instead. ## `geminiApiKey` (type: `string`): Your Google Gemini API key. Used only when no OpenAI key is provided. ## `openaiModel` (type: `string`): OpenAI model to use for AI report generation. ## `geminiModel` (type: `string`): Gemini model to use when no OpenAI key is provided. ## Actor input object example ```json { "maxPages": 100, "followLinks": true, "excelSheets": [], "generateAiReport": false, "openaiModel": "gpt-4.1-mini", "geminiModel": "gemini-2.0-flash" } ```` # API You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup. ## JavaScript example ```javascript import { ApifyClient } from 'apify-client'; // Initialize the ApifyClient with your Apify API token // Replace the '' with your token const client = new ApifyClient({ token: '', }); // Prepare Actor input const input = {}; // Run the Actor and wait for it to finish const run = await client.actor("crazydev.in/website-seo-auditor").call(input); // Fetch and print Actor results from the run's dataset (if any) console.log('Results from dataset'); console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`); const { items } = await client.dataset(run.defaultDatasetId).listItems(); items.forEach((item) => { console.dir(item); }); // 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs ``` ## Python example ```python from apify_client import ApifyClient # Initialize the ApifyClient with your Apify API token # Replace '' with your token. client = ApifyClient("") # Prepare the Actor input run_input = {} # Run the Actor and wait for it to finish run = client.actor("crazydev.in/website-seo-auditor").call(run_input=run_input) # Fetch and print Actor results from the run's dataset (if there are any) print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"]) for item in client.dataset(run["defaultDatasetId"]).iterate_items(): print(item) # 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start ``` ## CLI example ```bash echo '{}' | apify call crazydev.in/website-seo-auditor --silent --output-dataset ``` ## MCP server setup ```json { "mcpServers": { "apify": { "command": "npx", "args": [ "mcp-remote", "https://mcp.apify.com/?tools=crazydev.in/website-seo-auditor", "--header", "Authorization: Bearer " ] } } } ``` ## OpenAPI specification ```json { "openapi": "3.0.1", "info": { "title": "Website SEO Auditor", "description": "Crawl any website and get a full SEO audit: broken links, missing meta, H1 issues, thin content, duplicate titles, page speed, canonical, noindex, OG tags and schema. Exports a formatted Excel report. Optional AI report via OpenAI or Gemini.", "version": "0.0", "x-build-id": "VjuD56J05dVj4rIxc" }, "servers": [ { "url": "https://api.apify.com/v2" } ], "paths": { "/acts/crazydev.in~website-seo-auditor/run-sync-get-dataset-items": { "post": { "operationId": "run-sync-get-dataset-items-crazydev.in-website-seo-auditor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for its completion, and returns Actor's dataset items in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } }, "/acts/crazydev.in~website-seo-auditor/runs": { "post": { "operationId": "runs-sync-crazydev.in-website-seo-auditor", "x-openai-isConsequential": false, "summary": "Executes an Actor and returns information about the initiated run in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK", "content": { "application/json": { "schema": { "$ref": "#/components/schemas/runsResponseSchema" } } } } } } }, "/acts/crazydev.in~website-seo-auditor/run-sync": { "post": { "operationId": "run-sync-crazydev.in-website-seo-auditor", "x-openai-isConsequential": false, "summary": "Executes an Actor, waits for completion, and returns the OUTPUT from Key-value store in response.", "tags": [ "Run Actor" ], "requestBody": { "required": true, "content": { "application/json": { "schema": { "$ref": "#/components/schemas/inputSchema" } } } }, "parameters": [ { "name": "token", "in": "query", "required": true, "schema": { "type": "string" }, "description": "Enter your Apify token here" } ], "responses": { "200": { "description": "OK" } } } } }, "components": { "schemas": { "inputSchema": { "type": "object", "required": [ "startUrl" ], "properties": { "startUrl": { "title": "https://crazydev.in/", "type": "string", "description": "Full URL of the website to audit (e.g. https://crazydev.in/)." }, "maxPages": { "title": "Max Pages to Crawl", "minimum": 1, "maximum": 500, "type": "integer", "description": "Maximum number of HTML pages to visit. Ignored when followLinks is false.", "default": 100 }, "followLinks": { "title": "Crawl Whole Website", "type": "boolean", "description": "true → crawl the entire site up to maxPages. false → audit only the single URL.", "default": true }, "excelSheets": { "title": "Excel Sheets to Include", "type": "array", "description": "Tick the sheets you want in the Excel file. Leave all unticked to get every sheet.", "items": { "type": "string", "enum": [ "summary", "all_pages", "broken_links", "duplicate_titles", "duplicate_meta", "meta_issues", "h1_issues", "thin_content", "images_alt", "canonicalization", "noindex", "schema_og", "page_speed" ], "enumTitles": [ "Summary", "All Pages", "Broken Links", "Duplicate Titles", "Duplicate Meta Descriptions", "Meta Issues", "H1 Issues", "Thin Content (<300 words)", "Images Missing Alt", "Canonicalization", "NoIndex Pages", "Schema & OG Tags", "Page Speed" ] }, "default": [] }, "generateAiReport": { "title": "Generate AI SEO Report", "type": "boolean", "description": "Use OpenAI or Gemini to write a detailed, actionable audit. Requires an API key below.", "default": false }, "openaiApiKey": { "title": "OpenAI API Key", "type": "string", "description": "Your OpenAI API key for AI report generation. Leave blank to use Gemini instead." }, "geminiApiKey": { "title": "Gemini API Key", "type": "string", "description": "Your Google Gemini API key. Used only when no OpenAI key is provided." }, "openaiModel": { "title": "OpenAI Model", "enum": [ "gpt-4.1-mini", "gpt-4.1", "gpt-4o", "gpt-4o-mini" ], "type": "string", "description": "OpenAI model to use for AI report generation.", "default": "gpt-4.1-mini" }, "geminiModel": { "title": "Gemini Model", "enum": [ "gemini-2.0-flash", "gemini-2.5-flash", "gemini-2.5-pro" ], "type": "string", "description": "Gemini model to use when no OpenAI key is provided.", "default": "gemini-2.0-flash" } } }, "runsResponseSchema": { "type": "object", "properties": { "data": { "type": "object", "properties": { "id": { "type": "string" }, "actId": { "type": "string" }, "userId": { "type": "string" }, "startedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "finishedAt": { "type": "string", "format": "date-time", "example": "2025-01-08T00:00:00.000Z" }, "status": { "type": "string", "example": "READY" }, "meta": { "type": "object", "properties": { "origin": { "type": "string", "example": "API" }, "userAgent": { "type": "string" } } }, "stats": { "type": "object", "properties": { "inputBodyLen": { "type": "integer", "example": 2000 }, "rebootCount": { "type": "integer", "example": 0 }, "restartCount": { "type": "integer", "example": 0 }, "resurrectCount": { "type": "integer", "example": 0 }, "computeUnits": { "type": "integer", "example": 0 } } }, "options": { "type": "object", "properties": { "build": { "type": "string", "example": "latest" }, "timeoutSecs": { "type": "integer", "example": 300 }, "memoryMbytes": { "type": "integer", "example": 1024 }, "diskMbytes": { "type": "integer", "example": 2048 } } }, "buildId": { "type": "string" }, "defaultKeyValueStoreId": { "type": "string" }, "defaultDatasetId": { "type": "string" }, "defaultRequestQueueId": { "type": "string" }, "buildNumber": { "type": "string", "example": "1.0.0" }, "containerUrl": { "type": "string" }, "usage": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "integer", "example": 1 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } }, "usageTotalUsd": { "type": "number", "example": 0.00005 }, "usageUsd": { "type": "object", "properties": { "ACTOR_COMPUTE_UNITS": { "type": "integer", "example": 0 }, "DATASET_READS": { "type": "integer", "example": 0 }, "DATASET_WRITES": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_READS": { "type": "integer", "example": 0 }, "KEY_VALUE_STORE_WRITES": { "type": "number", "example": 0.00005 }, "KEY_VALUE_STORE_LISTS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_READS": { "type": "integer", "example": 0 }, "REQUEST_QUEUE_WRITES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_INTERNAL_GBYTES": { "type": "integer", "example": 0 }, "DATA_TRANSFER_EXTERNAL_GBYTES": { "type": "integer", "example": 0 }, "PROXY_RESIDENTIAL_TRANSFER_GBYTES": { "type": "integer", "example": 0 }, "PROXY_SERPS": { "type": "integer", "example": 0 } } } } } } } } } } ```