You can access the Sitemap Indexability & AI Crawler Audit API programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = { "domains": ["apify.com"] }
9
10# Run the Actor and wait for it to finish
11run = client.actor("dobus/sitemap-indexability-ai-crawler-audit").call(run_input=run_input)
12
13# Fetch and print Actor results from the run's dataset (if there are any)
14print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
15for item in client.dataset(run.default_dataset_id).iterate_items():
16    print(item)
17
18# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Sitemap Indexability & AI Crawler Audit API API in Python

The Apify API client for Python is the official library that allows you to use Sitemap Indexability & AI Crawler Audit API API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Sitemap Indexability & AI Crawler Audit API API in JavaScript

Sitemap Indexability & AI Crawler Audit API API through CLI

Sitemap Indexability & AI Crawler Audit API OpenAPI definition

Sitemap Indexability & AI Crawler Audit API API

Technical SEO & AI Crawler Audit

taroyamada/technical-seo-portfolio-regression-report

Audit public pages you are authorized to test for robots, noindex, sitemap, canonical, and AI crawler access changes. Deliver source-linked issues and portfolio reports.

naoki anzai

AI Crawler Access Checker

zinin/ai-crawler-access-checker

Audit up to 100 sites for 16 AI crawler policies. Get search vs training verdicts, robots.txt and llms.txt evidence, confidence, unknown states, priorities, and next actions for GEO/AEO reviews.

Tim Zinin

Company Domain Tech, DNS & Security Audit

taroyamada/company-enrichment-intelligence

Turn company domains into structured website, tech stack, DNS, SPF, DMARC, RDAP, TLS certificate, robots.txt, and sitemap audit records. Public, keyless sources only: the company's own website plus public registries. Pay per audited domain.

naoki anzai

Website RAG Readiness Audit Report

taroyamada/website-rag-readiness-audit

Turn public website URLs into a decision-ready RAG readiness audit with coverage, chunking risk, retrieval cleanup actions, source URLs, and no user API key requirement.

naoki anzai

robots.txt Parser & AI Crawler Block Checker

taroyamada/robotstxt-ai-checker

Audit robots.txt files across thousands of websites to detect specific crawl policies, disallowed paths, and user-agents for GPTBot and ClaudeBot.

naoki anzai

Website Lighthouse & WCAG Regression Report

taroyamada/website-lighthouse-accessibility-regression-report

Run Lighthouse and axe-core audits on authorized public websites, then generate performance, accessibility, SEO, and regression reports.

naoki anzai

Website SEO, Accessibility & AI Readiness Auditor

feeng/website-seo-ai-readiness-auditor

🔎 Crawl websites and turn technical SEO, accessibility, security, performance, broken-link, structured-data, robots.txt, llms.txt, and AI crawler signals into prioritized 0–100 audit scores and client-ready reports.

Daniel S.

SEO Audit API — On-Page + Core Web Vitals, Bulk & Scored

fetchbase/website-seo-audit

SEO audit with 0–100 score, real Core Web Vitals (LCP, CLS, FCP) measured in a live browser, and prioritized issues each with a concrete fix. Meta, headings, canonical, OG, JSON-LD, alt text, robots.txt, sitemap, broken links. Single pages or site crawls. Charged only per audited page.

Fetchbase

SEO Audit + AI Visibility · Are You Citable by ChatGPT?

siccscha/seo-health-auditor

Technical SEO audit plus the question no other audit answers: can AI systems cite you? Checks which AI crawlers your robots.txt allows (only retrieval agents can cite you), flags pages that are empty without JavaScript, and diffs against your previous run. Plus fixes you can paste.

Chris S

Robots Rule Tester - Would Google Crawl This URL?

eliai/robots-rule-tester

Test URLs against robots.txt with real Google semantics: longest-match, Allow wins ties, UA group selection (test Googlebot, GPTBot, ClaudeBot...), wildcards. Verdict + the exact rule that decided it + sitemaps. $0.0008 per URL, invalid URLs never charged — vs $0.001-$0.15 measured incumbents.

Anthony Snider

Website Metadata Extractor

scrapers-hub/website-metadata-extractor

Website metadata extractor to extract titles, descriptions, keywords, and meta tags from any website 🌐📊 Perfect for SEO analysis, auditing, and research. Fast, accurate, and scalable extraction.