You can access the Chinese AI Crawler Access Checker for robots.txt programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1import { ApifyClient } from 'apify-client';
2
3// Initialize the ApifyClient with your Apify API token
4// Replace the '<YOUR_API_TOKEN>' with your token
5const client = new ApifyClient({
6    token: '<YOUR_API_TOKEN>',
7});
8
9// Prepare Actor input
10const input = {
11    "sites": [
12        "https://example.com",
13        "https://apify.com"
14    ],
15    "paths": [
16        "/"
17    ],
18    "bots": [
19        "Baiduspider",
20        "Baidubot",
21        "Bytespider",
22        "Bytedance",
23        "Doubao",
24        "DeepSeekBot",
25        "ChatGLM-Spider",
26        "Qwenbot",
27        "PanguBot",
28        "PetalBot",
29        "Kimi",
30        "Hunyuan",
31        "YiBot",
32        "SenseBot",
33        "iFlytekBot",
34        "MiniMaxBot",
35        "InternLMBot",
36        "360Spider",
37        "Sogou web spider",
38        "Yisouspider"
39    ],
40    "checkLlms": true,
41    "maxItems": 2
42};
43
44// Run the Actor and wait for it to finish
45const run = await client.actor("zinin/chinese-ai-crawler-access-checker").call(input);
46
47// Fetch and print Actor results from the run's dataset (if any)
48console.log('Results from dataset');
49console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
50const { items } = await client.dataset(run.defaultDatasetId).listItems();
51items.forEach((item) => {
52    console.dir(item);
53});
54
55// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

Chinese AI Crawler Access Checker API in JavaScript

The Apify API client for JavaScript is the official library that allows you to use Chinese AI Crawler Access Checker for robots.txt API in JavaScript or TypeScript, providing convenience functions and automatic retries on errors.

Install the apify-client

$npm install apify-client

Other API clients include:

Chinese AI Crawler Access Checker for robots.txt API in Python

Chinese AI Crawler Access Checker for robots.txt API through CLI

Chinese AI Crawler Access Checker for robots.txt OpenAPI definition

Chinese AI Crawler Access Checker for robots.txt API

AI Crawler Robots.txt Audit & llms.txt Checker

davidbenittah/ai-crawler-robots-audit

Check robots.txt and llms.txt on up to 50 sites and see which AI crawlers are blocked: OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, GPTBot and ClaudeBot. Returns a 0-100 AI search access score, the rule matched per bot, and a paste-ready robots.txt fix.

David

AI Crawler Readiness Auditor

nectared_screen/ai-crawler-readiness-auditor

Audit domains for llms.txt, robots.txt AI bot rules, sitemap hints, and public AI crawler readiness signals.

jaehan byun

LLMs.txt AI Discovery Auditor

glowing_glove/llms-txt-ai-discovery-auditor

Check websites for llms.txt, llms-full.txt, robots AI crawler rules, sitemap hints, and AI search readiness gaps.

Ushba Khan

AI Crawler & llms.txt Policy Auditor

quanmatrix/ai-crawler-llmstxt-policy-auditor

Audit robots.txt policies for major AI crawlers and inspect llms.txt discovery files for public websites with structured machine-readable results.

Rafael Barreto Haddad

AI Crawler Policy Lookup: robots.txt & llms.txt Checker

accountable_eel/ai-crawler-policy-lookup

Check what a website's robots.txt says about AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and more) and whether it publishes an llms.txt. Reads the site's own public files directly: no API key, no third-party service. Charged only when an explicit AI policy or llms.txt is found.

Adrian Voss

llms.txt Auditor & AI Crawler Policy Checker

zinin/llms-txt-auditor

Audit public llms.txt, llms-full.txt, and root robots.txt rules for nine named AI crawlers. Get evidence-backed presence, policy, confidence, gaps, and review actions for each complete domain audit.

Tim Zinin

LLMs.txt / AI Readiness Auditor

civicdataworks/llms-txt-ai-readiness-auditor

Audit websites for AI crawler/readiness basics: llms.txt, sitemap, robots rules, titles, metadata, and AI crawler directives.

Rowan Mercer

AI Training Blocker Checker

bipbip-apis/ai-training-blocker-checker

Check robots.txt, llms.txt, sitemap hints, and AI crawler blocking rules for websites and domains.

Daniel Christensen

AI Bot & LLM Crawler Exposure Auditor

glowing_glove/ai-bot-llm-crawler-exposure-auditor

Audit robots.txt, llms.txt, AI crawler directives, public content exposure, and policy gaps for websites in the AI search era.

Ushba Khan

AI Access Audit (robots.txt + llms.txt)

conserving_mastodon/ai-access-audit

How does a site present itself to AI? Per-crawler robots.txt verdicts for 13 major AI user agents (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and more), llms.txt presence and shape, sitemap signals, and a concrete fix list. Charged only when the audit completes.