Pricing

$6.00 / 1,000 audited sites

Sitemap & Robots SEO Index Auditor

Audit robots.txt, sitemap discovery, indexability signals, canonical tags, and SEO crawl readiness for business websites.

Pricing

$6.00 / 1,000 audited sites

Rating

0.0

(0)

Developer

Ushba Khan

Actor stats

Bookmarked

Total users

Monthly active users

a day ago

Last modified

Sitemap & Robots SEO Index Auditor API through CLI

The Apify CLI is the official tool that allows you to use Sitemap & Robots SEO Index Auditor locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

Sitemap & Robots SEO Index Auditor API in Python

Sitemap & Robots SEO Index Auditor API in JavaScript

Sitemap & Robots SEO Index Auditor OpenAPI definition

Sitemap & Robots SEO Index Auditor API

Sitemap URL Discovery (sitemap.xml + robots.txt → all URLs)

gochujang/sitemap-url-discovery

Given a domain, finds sitemap.xml / sitemap_index.xml (also via robots.txt), recursively expands sitemap indexes, returns one row per discovered URL with lastmod / changefreq / priority. SEO audits, crawl-target prep, content cataloging. $0.0001/URL + $0.01 site fee.

Hojun Lee

Robots.txt & Sitemap Analyzer

automation-lab/robots-sitemap-analyzer

This actor fetches and parses robots.txt and sitemap.xml files for any list of websites. It extracts crawl directives (user-agent rules, allowed/disallowed paths, crawl-delay), discovers sitemap URLs, and counts the number of pages listed in each sitemap. Use it for SEO audits, competitive...

Stas Persiianenko

Website Metadata Extractor (meta tags, sitemap, robots) 🔎

powerful_bachelor/website-metadata-extractor

🔍 Website Metadata Extractor 🌐 Extract essential website data: meta tags, robots.txt, and sitemap.xml in one scan. 📊 Analyze SEO elements, crawler directives, and site structure. ✅ Perfect for SEO audits, 🔎 competitor research, and 🚀 understanding how search engines view your website.

Powerful Bachelor

Lighthouse Batch Auditor — Performance, SEO & Core Web Vitals

accurate_pouch/lighthouse-auditor

Batch Lighthouse audits via Google PageSpeed Insights API. Performance, SEO, accessibility scores + Core Web Vitals (LCP, FID, CLS) for 100s of URLs. 3 audits free per run.

Manchitt Sanan

Woorank SEO Auditor & Website Analyzer

dev00/woorank-seo-auditor

Comprehensive website auditor analyzing On-Page SEO, Mobile friendliness, structured schema validation, Core Web Vitals standing, security standard, classification tags and estimated traffic.

dev00

Website Sitemap Extractor

glassventures/website-sitemap-extractor

Extract all URLs from any website's sitemap. Auto-discovers sitemaps from robots.txt, supports sitemap index files and .gz compression. Filter by URL pattern, date range.

Glass Ventures

Sitemap URL Extractor

seemuapps/sitemap-extractor

Extract every URL from a website's sitemap.xml. Recursively walks nested sitemap indexes and returns loc, lastmod, changefreq, and priority for each page.

Andrew

Sitemap Validator

maximedupre/sitemap-validator

Validate XML sitemaps and sitemap indexes. Check listed URLs for HTTP status, redirects, final URL, response time, malformed URLs, and sitemap metadata.

Maxime Dupré

Sitemap Crawler - XML Sitemap URL Extractor

miccho27/sitemap-crawler

Extract all URLs from XML sitemaps (including sitemap index) and optionally audit each page

Tatsuya Mizuno

SEO Site Checker (Pay per Event)

eiv/seo-site-checker

Crawl any website and extract 70+ on-site SEO metrics — meta tags, Core Web Vitals, structured data, mobile-friendliness, security headers, and page speed. Get a complete SEO audit with per-check scores and actionable recommendations.