Website Sitemap & Robots Audit
Pricing
Pay per usage
Go to Apify Store
Website Sitemap & Robots Audit
Find robots.txt, declared sitemaps, homepage metadata, canonical URL, and basic crawlability signals for a list of websites.
Website Sitemap & Robots Audit
Pricing
Pay per usage
Find robots.txt, declared sitemaps, homepage metadata, canonical URL, and basic crawlability signals for a list of websites.
Websites or pages to audit. Domains without scheme are treated as https://.
Per-request timeout.