Pricing

from $0.43 / 1,000 results

Robots.txt & Sitemap SEO Auditor

Crawl Policy and Indexability Intelligence preserving robots/sitemap auditing while adding health scores, fingerprints, drift and SEO release gating. Returns structured, machine-readable results for repeatable research, monitoring, automation, Apify Tasks, API workflows, and AI.

Pricing

from $0.43 / 1,000 results

Rating

0.0

(0)

Developer

Rafael Barreto Haddad

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Automation Lab

SEO Checker — Website SEO Audit & Score in Bulk

maged120/seobility-seo-checker

Bulk SEO audits for any list of URLs: overall score, category breakdowns (meta, structure, content, links) and actionable hints — no SEO tool subscription needed.

Maged

Sitemap Extractor

cerebral_aluminum/sitemap-extractor

Extract all URLs from website sitemaps. Pages, images, PDFs. Handles sitemap indexes and WordPress.

Benny

Sitemap & Robots SEO Index Auditor

glowing_glove/sitemap-robots-index-auditor

Audit robots.txt, sitemap discovery, indexability signals, canonical tags, and SEO crawl readiness for business websites.

Ushba Khan

Sitemap Audit

apage/sitemap-audit

Get a Sitemap Health Score (0-100) for any website. Discover, parse, and validate XML sitemaps. Find 404s, redirects, canonical mismatches, noindex conflicts, hreflang issues, missing pages and estimate crawl budget waste.

Andy Page

Sitemap Freshness Auditor

phoenix2810/sitemap-freshness-auditor

Audit a public XML sitemap for lastmod coverage, stale URLs, child sitemap indexes, score, grade, and SEO maintenance recommendations.

Sanskar Jaiswal

Sitemap Sniffer

maximedupre/sitemap-sniffer

Find sitemap files from website roots, domains, robots.txt, and direct sitemap URLs. Export sitemap metadata, URL counts, nested index depth, and optional URL inventory rows.

Maxime Dupré

Robots.txt & Sitemap Auditor

phoenix2810/robots-sitemap-auditor

Audit a website's robots.txt directives and sitemap discovery in one fast API call. Detect blocked paths, missing sitemaps, and crawlability issues. Built for SEO agencies, technical SEO consultants, and site migration QA teams.

Sanskar Jaiswal

Robots.txt Tester & Validator

gifted_wagon/robots-txt-evidence-auditor

Parse robots.txt rules into normalized policy evidence, sitemap references, tested paths, and truthful failures.

Michael Olmos

On-Page SEO Auditor - Meta, Headings & Issues

antishock/onpage-seo-auditor

Audit on-page SEO for any list of URLs: title and meta description with lengths, canonical, robots meta, indexability, H1 to H6 structure, word count, image alt coverage, internal and external links, Open Graph, JSON-LD schema types, hreflang and a plain-language list of issues found.