Pricing

from $5.00 / 1,000 results

SEO Audit: On-Page, Redirects & AI Crawler Access

Audits pages for on-page and technical SEO, and adds four checks general auditors skip: AI crawler access in robots.txt, llms.txt, redirects that drop the path, and noindex sent via X-Robots-Tag.

Pricing

from $5.00 / 1,000 results

Rating

0.0

(0)

Developer

Ai-Q Labs

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

SEO tools

Developer tools

Automation

You can access the SEO Audit: On-Page, Redirects & AI Crawler Access programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "urls": [
12        "https://apify.com",
13        "https://www.wordpress.org"
14    ]
15};
16
17// Run the Actor and wait for it to finish
18const run = await client.actor("aiqlabs/seo-audit-tool").call(input);
19
20// Fetch and print Actor results from the run's dataset (if any)
21console.log('Results from dataset');
22console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
23const { items } = await client.dataset(run.defaultDatasetId).listItems();
24items.forEach((item) => {
25    console.dir(item);
26});
27
28// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

SEO Audit Tool: On-Page, Redirect & AI Crawler Checker API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use SEO Audit: On-Page, Redirects & AI Crawler Access API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

SEO Audit: On-Page, Redirects & AI Crawler Access API in Python

SEO Audit: On-Page, Redirects & AI Crawler Access API through CLI

SEO Audit: On-Page, Redirects & AI Crawler Access OpenAPI definition

SEO Audit: On-Page, Redirects & AI Crawler Access API

AI SEO Audit: robots.txt, llms.txt & 26 AI Crawlers

aiqlabs/seo-ai-visibility-auditor

Audits any URL for classic SEO health and for AI/LLM discoverability - AI crawler access in robots.txt, llms.txt, structured data, metadata - in a single pass.

Ai-Q Labs

Technical SEO & AI Crawler Audit

taroyamada/technical-seo-portfolio-regression-report

Audit public pages you are authorized to test for robots, noindex, sitemap, canonical, and AI crawler access changes. Deliver source-linked issues and portfolio reports.

naoki anzai

AI Crawler Robots.txt Audit & llms.txt Checker

davidbenittah/ai-crawler-robots-audit

Check robots.txt and llms.txt on up to 50 sites and see which AI crawlers are blocked: OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, GPTBot and ClaudeBot. Returns a 0-100 AI search access score, the rule matched per bot, and a paste-ready robots.txt fix.

David

AI Crawler Readiness Auditor

nectared_screen/ai-crawler-readiness-auditor

Audit domains for llms.txt, robots.txt AI bot rules, sitemap hints, and public AI crawler readiness signals.

jaehan byun

Robots Indexability Audit

toronto_777/robots-indexability-audit

Audit public robots.txt, sitemap declarations, homepage robots directives, and crawler allow/block signals for SEO and AI visibility checks.

Steven Feng

LLMs.txt / AI Readiness Auditor

civicdataworks/llms-txt-ai-readiness-auditor

Audit websites for AI crawler/readiness basics: llms.txt, sitemap, robots rules, titles, metadata, and AI crawler directives.

Rowan Mercer

AI Visibility Site Audit — robots.txt & llms.txt checks

43sunsets/ai-visibility-site-audit

Audit how visible your own website is to AI crawlers and assistants: robots.txt rules for 13 AI bots, llms.txt, structured data, meta hygiene and sitemap — with a scored report and a ready-to-edit llms.txt draft.