Website SEO Audit Crawler — On-Page SEO Analyzer & Spider 🔍

Audit the on-page SEO of an entire website in one run. This SEO crawler / SEO spider crawls a whole site and runs a full on-page SEO audit on every page — titles, meta descriptions, headings, canonical tags, robots/indexability, Open Graph, schema.org types, word count, image alt coverage and internal/external link counts — plus a ready-made list of detected SEO issues.

Point it at one URL and it audits thousands of pages automatically. No login, no headless browser, one row per page.

Looking for a technical SEO audit tool, on-page SEO checker, meta tag checker, title tag checker or a bulk website SEO analyzer? This actor does the full crawl-and-audit at scale.

---

✨ Key features

• 🕷️ Full-site crawl — start from one URL and follow internal links across the whole domain.
• 🏷️ Complete on-page data — title, meta description, H1/H2, canonical, robots, Open Graph, Twitter cards, hreflang, charset, viewport.
• 🧱 Structured data detection — extracts schema.org @types from JSON-LD.
• 🚩 Automatic issue flags — missing titles, duplicate/multiple H1, thin content, missing meta, missing canonical, noindex, images without alt, and more.
• 🔢 Quality metrics — honest word count (boilerplate removed), image alt coverage, internal/external link counts.
• ⚡ Fast & cheap — pure HTTP, no browser, high concurrency.

💡 Use cases

• Technical SEO audits — surface on-page issues across a whole site in a single run.
• Content audits — spot thin content, missing meta descriptions and duplicate titles.
• Pre-launch QA — verify titles, canonicals and indexability before going live.
• SEO monitoring — schedule the crawl and track on-page SEO health over time.
• Migration checks — confirm meta, canonicals and indexability survived a redesign.

📦 What you get

One row per page, including:

Field	Description
url, statusCode	Page URL and HTTP status
title, titleLength	Title tag and its length
metaDescription, metaDescriptionLength	Meta description and length
h1, h1Count, h2Count	Headings
canonical, metaRobots, isIndexable	Indexability signals
lang, charset, hasViewport, hreflangCount	Technical tags
wordCount	Body word count (boilerplate removed)
imagesCount, imagesMissingAlt	Image alt coverage
internalLinks, externalLinks	Link counts
ogTitle, ogDescription, ogImage, twitterCard	Social tags
schemaTypes	Detected schema.org @types
issues	Detected on-page SEO problems

Detected issues

missing-title, title-too-long, title-too-short, missing-meta-description, meta-description-too-long, meta-description-too-short, missing-h1, multiple-h1, missing-canonical, noindex, images-missing-alt, missing-viewport, thin-content.

Example output

{
  "url": "https://example.com/blog/post",
  "statusCode": 200,
  "title": "How to Do On-Page SEO",
  "titleLength": 22,
  "metaDescriptionLength": 0,
  "h1": ["How to Do On-Page SEO"],
  "h1Count": 1,
  "wordCount": 1240,
  "imagesMissingAlt": 3,
  "internalLinks": 41,
  "externalLinks": 6,
  "schemaTypes": ["Article", "BreadcrumbList"],
  "issues": ["missing-meta-description", "images-missing-alt"]
}

🚀 How to use it

1. Click Try for free / Start.
2. Paste one or more website URLs into Start URLs.
3. (Optional) Set Max pages to crawl — 0 to audit the whole site.
4. Click Save & Start.
5. Export the audit as JSON, CSV, Excel or via API, and sort/filter by the issues column.

⚙️ Input

Option	Description	Default
startUrls	Websites to crawl	– (required)
maxPagesToCrawl	Max pages per run (0 = whole site)	1000
maxConcurrency	Parallel requests	10

Example input

{
  "startUrls": [{ "url": "https://example.com" }],
  "maxPagesToCrawl": 5000
}

🔍 How it works

The crawler follows internal links within the same domain as your Start URLs and analyzes the server-rendered HTML of each page: it reads all on-page SEO tags, counts headings/links/images, computes a boilerplate-free word count, detects schema.org types, and flags common SEO issues. Pure HTTP — fast and cheap, no headless browser.

🧰 Tips & best practices

• Sort or filter by the issues field to build a prioritized SEO fix-list.
• Use titleLength / metaDescriptionLength to catch tags that will be truncated in search results.
• Filter isIndexable: false to find pages accidentally set to noindex.
• Set maxPagesToCrawl to 0 for a complete site audit; schedule it to monitor SEO health.

❓ FAQ

Does it render JavaScript? No — it audits server-rendered HTML, which is what search engines index first, and keeps runs fast and cheap.

Does it detect structured data? Yes — it extracts schema.org @types from JSON-LD on each page.

How is wordCount calculated? From the body text after removing scripts, styles, nav, header, footer and sidebars — an honest content word count.

How do I audit the whole site? Set maxPagesToCrawl to 0.

What formats can I export? JSON, CSV, Excel, HTML and a full REST API.

🔗 Related actors by the same author

• Broken Link Checker — crawl a site and find dead links with HTTP status codes.
• Website Link Graph & Outbound Links Crawler — map internal & outbound links.
• JSON-LD Schema & Meta Tag Extractor — deep structured-data & meta extraction per URL.
• Sitemap to URL Crawler — extract all URLs from any sitemap.xml.

---

Changelog

• 2026-05-25 — Maintenance & reliability pass: pulled the latest source and rebuilt the Actor on the current base image; build verified.

Last reviewed: 2026-05-25.