AI SEO Sitemap Generator & Website Audit

AI SEO Sitemap Generator & Website Audit

Generate complete, deduplicated XML sitemaps (plus optional image and video sitemaps) and run a full SEO crawl audit on any website — even sites with no existing sitemap. The actor reads robots.txt, follows sitemap directives, audits URLs directly, and falls back to fast Cheerio discovery crawling when no sitemap exists.

What You Get

• sitemap.xml — Auto-split at 50k URLs with sitemap index
• image-sitemap.xml — Product and content image URLs
• video-sitemap.xml — Embedded video URLs with metadata
• robots.txt — Generated if missing
• Per-page SEO dataset — Status, titles, descriptions, canonicals, H1, word counts, link counts, broken links, assets, depth, priority, changefreq
• Run summary — 0-100 SEO score, error/warning counts, page-type distribution, generated files

SEO Issues Detected (12+)

Broken links, redirect chains, missing titles, missing descriptions, missing canonicals, multiple H1 tags, noindex pages, orphan pages, duplicate titles, duplicate descriptions, duplicate canonicals, slow pages, large pages, thin content.

Page Type Classification

Automatically classifies every page: Homepage, Product, Article, Category, FAQ, Contact, Legal, PDF, Image, Video, and more. Each type gets smart priority and changefreq estimates.

Use Cases

• SEO agencies — Full site audits and client reports
• Site migrations — Generate and compare sitemaps before and after
• E-commerce — Priority heuristics and image sitemaps for product pages
• Content sites — Detect duplicate titles, orphan posts, thin content
• Scheduled monitoring — Detect new pages, broken links, update sitemaps
• DevOps — Integrate SEO score into alerts and monitoring

How to Use

1. Enter one or more start URLs
2. Optionally configure max pages, crawl depth, and output options
3. Run the actor
4. Download sitemap XML from the Key-Value Store and page data from the Dataset

Example Output

{
  "url": "https://example.com/product/123",
  "statusCode": 200,
  "title": "Product Name - Example Store",
  "metaDescription": "Buy Product Name at the best price...",
  "canonical": "https://example.com/product/123",
  "h1": "Product Name",
  "wordCount": 456,
  "internalLinks": 12,
  "externalLinks": 3,
  "images": ["https://example.com/img/product.jpg"],
  "pageType": "Product",
  "priority": 0.8,
  "changefreq": "weekly",
  "issues": ["missing-meta-description-length"],
  "crawlDepth": 2,
  "loadTimeMs": 342
}

Technical Details

• Dual engine: CheerioCrawler for static pages, Playwright only for JS-rendered pages
• Smart rendering: Detects React/Vue/Next.js/Nuxt/Angular and only uses browser when needed
• Resource blocking: Images, fonts, media and stylesheets blocked in Playwright to save bandwidth
• Anti-bot: Apify Proxy rotation support
• Output format: Structured JSON via Apify Dataset + XML files in Key-Value Store