You can access the Chinese AI Crawler Access Checker for robots.txt programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = {
9    "sites": [
10        "https://example.com",
11        "https://apify.com",
12    ],
13    "paths": ["/"],
14    "bots": [
15        "Baiduspider",
16        "Baidubot",
17        "Bytespider",
18        "Bytedance",
19        "Doubao",
20        "DeepSeekBot",
21        "ChatGLM-Spider",
22        "Qwenbot",
23        "PanguBot",
24        "PetalBot",
25        "Kimi",
26        "Hunyuan",
27        "YiBot",
28        "SenseBot",
29        "iFlytekBot",
30        "MiniMaxBot",
31        "InternLMBot",
32        "360Spider",
33        "Sogou web spider",
34        "Yisouspider",
35    ],
36    "checkLlms": True,
37    "maxItems": 2,
38}
39
40# Run the Actor and wait for it to finish
41run = client.actor("zinin/chinese-ai-crawler-access-checker").call(run_input=run_input)
42
43# Fetch and print Actor results from the run's dataset (if there are any)
44print(f"💾 Check your data here: https://console.apify.com/storage/datasets/{run.default_dataset_id}")
45for item in client.dataset(run.default_dataset_id).iterate_items():
46    print(item)
47
48# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Chinese AI Crawler Access Checker API in Python

The Apify API client for Python is the official library that allows you to use Chinese AI Crawler Access Checker for robots.txt API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Chinese AI Crawler Access Checker for robots.txt API in JavaScript

Chinese AI Crawler Access Checker for robots.txt API through CLI

Chinese AI Crawler Access Checker for robots.txt OpenAPI definition

Chinese AI Crawler Access Checker for robots.txt API

AI Crawler Robots.txt Audit & llms.txt Checker

davidbenittah/ai-crawler-robots-audit

Check robots.txt and llms.txt on up to 50 sites and see which AI crawlers are blocked: OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, GPTBot and ClaudeBot. Returns a 0-100 AI search access score, the rule matched per bot, and a paste-ready robots.txt fix.

David

AI Crawler Readiness Auditor

nectared_screen/ai-crawler-readiness-auditor

Audit domains for llms.txt, robots.txt AI bot rules, sitemap hints, and public AI crawler readiness signals.

jaehan byun

LLMs.txt AI Discovery Auditor

glowing_glove/llms-txt-ai-discovery-auditor

Check websites for llms.txt, llms-full.txt, robots AI crawler rules, sitemap hints, and AI search readiness gaps.

Ushba Khan

AI Crawler & llms.txt Policy Auditor

quanmatrix/ai-crawler-llmstxt-policy-auditor

Audit robots.txt policies for major AI crawlers and inspect llms.txt discovery files for public websites with structured machine-readable results.

Rafael Barreto Haddad

AI Crawler Policy Lookup: robots.txt & llms.txt Checker

accountable_eel/ai-crawler-policy-lookup

Check what a website's robots.txt says about AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, and more) and whether it publishes an llms.txt. Reads the site's own public files directly: no API key, no third-party service. Charged only when an explicit AI policy or llms.txt is found.

Adrian Voss

llms.txt Auditor & AI Crawler Policy Checker

zinin/llms-txt-auditor

Audit public llms.txt, llms-full.txt, and root robots.txt rules for nine named AI crawlers. Get evidence-backed presence, policy, confidence, gaps, and review actions for each complete domain audit.

Tim Zinin

LLMs.txt / AI Readiness Auditor

civicdataworks/llms-txt-ai-readiness-auditor

Audit websites for AI crawler/readiness basics: llms.txt, sitemap, robots rules, titles, metadata, and AI crawler directives.

Rowan Mercer

AI Training Blocker Checker

bipbip-apis/ai-training-blocker-checker

Check robots.txt, llms.txt, sitemap hints, and AI crawler blocking rules for websites and domains.

Daniel Christensen

AI Bot & LLM Crawler Exposure Auditor

glowing_glove/ai-bot-llm-crawler-exposure-auditor

Audit robots.txt, llms.txt, AI crawler directives, public content exposure, and policy gaps for websites in the AI search era.

Ushba Khan

AI Access Audit (robots.txt + llms.txt)

conserving_mastodon/ai-access-audit

How does a site present itself to AI? Per-crawler robots.txt verdicts for 13 major AI user agents (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot and more), llms.txt presence and shape, sitemap signals, and a concrete fix list. Charged only when the audit completes.