Sitemap Indexability & Change Monitor

Website Change Intelligence

ib4ngz/website-change-intelligence

Monitor websites with persistent semantic baselines, noise-resistant diffs, severity scoring, and rule-based intelligence.

🗺️ Sitemap Scraper & Analyzer

taroyamada/sitemap-analyzer

Extract thousands of URLs from complex nested XML sitemaps to audit website structure, HTTP status codes, and indexability for technical SEO.

robots.txt Parser & AI Crawler Block Checker

taroyamada/robotstxt-ai-checker

Check if sites block GPTBot/ClaudeBot. Paste domains and Start. CSV/JSON.

AI Crawler Access Checker

zinin/ai-crawler-access-checker

Audit up to 100 sites for 16 AI crawler policies. Get search vs training verdicts, robots.txt and llms.txt evidence, confidence, unknown states, priorities, and next actions for GEO/AEO reviews.

Website Lighthouse & WCAG Regression Report

taroyamada/website-lighthouse-accessibility-regression-report

Run Lighthouse and axe-core audits on authorized public websites, then generate performance, accessibility, SEO, and regression reports.

Technical SEO Audit & Indexability Checker

getascraper/seo-release-indexability-guard

Use as a website SEO checker for public and staging URLs. Run a technical SEO audit for indexability, noindex, robots.txt, canonical tags, redirects, meta tags, sitemaps, internal links, and structured data. Get prioritized fixes and change tracking. No login or API token required. Pay per event.

On Page SEO Audit Scraper

automation-lab/multi-page-on-page-seo-audit

Crawl public websites and export page-level on-page SEO metadata, indexability, links, content signals, and issue flags.

Monitor XML sitemaps, check public URL health, persist snapshots, and return only added, removed, or changed pages for SEO and automation.

Website SEO Audit & Regression Monitor

automa-flow/website-seo-audit-monitor

Audit complete websites for technical SEO issues, then monitor verified regressions and recoveries across scheduled runs. Crawl via HTTP and sitemaps, get stable issue IDs and webhook-ready events, and keep the last good state when a page is blocked or a crawl is incomplete.

Orphan Page Finder

junipr/orphan-page-finder

Find orphan pages by comparing sitemap URLs, crawl-discovered URLs, and internal link graph relationships.

Audit website migrations: validate redirect chains, destinations, canonicals, and indexability between old and new URL sets.