Pricing

$8.00 / 1,000 site audits

Try for free

Go to Apify Store

Website AI-Readiness Audit

Try for free

Enter a domain to get a 0–100 score, a grade and a prioritized list of fixes. It checks AI crawler access in robots.txt, llms.txt, your sitemap, HTTPS, and samples pages for text that loads without JavaScript, JSON-LD, titles and headings. Includes a Markdown report.

Pricing

$8.00 / 1,000 site audits

Rating

0.0

(0)

Developer

William Schultz

Actor stats

Bookmarked

Total users

Monthly active users

18 hours ago

Last modified

2026-11-02 (security update)

Security

Connections are pinned to the addresses that passed the private-address check. Each host name is checked again when the connection opens, including redirect hops and robots.txt, so a name that switches to a private address after the first lookup (DNS rebinding) is never connected to. Private IP addresses written directly in a URL are refused too. TLS still verifies the host name.

Changed

If a site's robots.txt host resolves to a private, loopback, link-local or reserved address, the item is now a free blocked-private (not robots-unavailable), not a robots.txt result.

0.1.3 (2026-11-02)

Fixed

Every item that wasn't audited now has an errorCode. Inputs that aren't a URL or domain get a free invalid-input item, and unexpected failures get internal-error.
The host name is looked up first. A domain that doesn't resolve now gets a free unreachable item ("DNS lookup failed (ENOTFOUND)") with no request sent, not even robots.txt. In 0.1.1 it came back as robots-unavailable. (Build 0.1.2 was an internal beta test build and was never released.) The same lookup feeds the private-address check.

0.1.1 (2026-11-02, first public release)

Added

AI-readiness score (0–100) and grade with fixes: robots.txt rules for 16 AI crawlers, llms.txt, sitemap, HTTPS, and sampled-page checks for server-rendered text, JSON-LD, titles, headings, robots directives, dates and canonicals. Markdown report included.
errorCode on items that weren't audited: robots-disallowed, robots-unavailable, redirect-signin, blocked-private, http-error or unreachable. Invalid inputs had no errorCode in this build.
redirectedTo and a redirected finding when the homepage redirects to another host.

Changed

robots.txt is read before any other request to a host (RFC 9309). If it can't be fetched (server error, 429 or network error), the site isn't audited.
llms.txt, llms-full.txt and sitemap probes are checked against robots.txt, like sampled pages.
About 1 request per second per host, or the robots.txt Crawl-delay if longer (up to 30 s), counted from the robots.txt request. Retry-After is honoured, and a host that answers 429 three times in a row gets no further requests. ownSiteConfirmed is required to relax robots.txt or the delay for your own sites.
Only the first 256 KB of llms-full.txt is read. Default memory is 256 MB.
Homepages that redirect to a sign-in page aren't audited. Private, loopback, link-local and reserved addresses are never requested.
Different spellings of the same site are audited and charged once.

Pricing

Pay per event: site-audit at $8 per 1,000 completed audits ($0.008 each). Unreachable, blocked and private-address sites are saved with an error and not charged.

AI Readiness Auditor

rationalistic_counsel/ai-readiness-auditor

Check how AI-ready any website is. Get an AI Readiness Score (0-100) checking llms.txt, robots.txt AI crawler directives, Schema.org structured data, and meta tags. No API key needed.

J N

SEO Audit & Markdown Content Scraper

quaking_pail/ai-seo-content-markdown-scraper

Audit every page of a website for SEO (title, meta description, headings, canonical, Open Graph, status code) and get its main content as clean Markdown for AI. Headless Chrome, API.

AI_Builder

103

5.0

(2)

GEO / AEO Website Audit — AI Search Readiness

rtworule/ai-search-readiness-auditor

Audit public websites for GEO and AEO readiness: AI crawler access, robots.txt, llms.txt, sitemaps, Schema.org, social metadata, scores, and prioritized fixes.

Kunteper Koyu

SEO Audit Tool - Website Crawler & Broken Link Checker

groupoject/technical-seo-audit-crawler

SEO audit tool and website crawler: 0-100 score and A-F grade per page, prioritized issues with fixes, broken links, duplicate titles and meta descriptions, indexability, headings, alt text, JSON-LD, security headers and optional Core Web Vitals.

Group Oject

Sitemap Indexability & AI Crawler Audit API

dobus/sitemap-indexability-ai-crawler-audit

Audit sitemap URLs, robots.txt, HTTP status, canonical/noindex signals, and AI crawler access as structured JSON for technical SEO and agents.

Afonso Fernandes

Sitemap Audit

apage/sitemap-audit

Get a Sitemap Health Score (0-100) for any website. Discover, parse, and validate XML sitemaps. Find 404s, redirects, canonical mismatches, noindex conflicts, hreflang issues, missing pages and estimate crawl budget waste.

Andy Page

SEO Audit API — On-Page + Core Web Vitals, Bulk & Scored

fetchbase/website-seo-audit

SEO audit with 0–100 score, real Core Web Vitals (LCP, CLS, FCP) measured in a live browser, and prioritized issues each with a concrete fix. Meta, headings, canonical, OG, JSON-LD, alt text, robots.txt, sitemap, broken links. Single pages or site crawls. Charged only per audited page.

Fetchbase

Website SEO Audit

brightpath-data/website-seo-audit

Titles, metas, headings, status codes, broken links, canonicals, robots and sitemap checks for any list of URLs, no browser needed

Nick Randall

SEO Audit Tool: On-Page SEO Checker & Website Crawler

tinplatelabs/seo-audit

SEO audit of any URL or whole site: titles, meta descriptions, headings, canonical, noindex, hreflang, Open Graph, schema JSON-LD, alt text, broken links, redirects, speed. 0-100 score, prioritized fixes, duplicate titles and site summary. No browser, no AI. $0.005/page.

tinplatelabs

AEO Audit: AI Crawler, Agent & llms.txt Readiness

ruesandora/ai-agent-readiness-audit

One audit for AI search and AI agent readiness: AI crawler access, readable content, structured data, llms.txt and sitemap, agent discovery files. One score 0-100, scores per section and a ranked fix list per site. Bulk URLs.

Rues Forum

Website AI-Readiness Audit

Changelog