Check GPTBot and ClaudeBot Access to Your Site

Created by

Chris Arsenault

Actor

AI Access Audit (robots.txt + llms.txt)

Is your site open or closed to GPTBot, ClaudeBot, PerplexityBot and 10 more AI crawlers? Exact per-bot verdicts in one call.

Try for free

AI Access Audit (robots.txt + llms.txt)conserving_mastodon/ai-access-audit

AI crawler

Purpose

Verdict

Decided by

Input

Site URL(required):https://anthropic.com

Output fields

AI crawler

Purpose

Verdict

Decided by

How it works

Sign up on Apify or log in

The AI Access Audit (robots.txt + llms.txt) Actor is ready to run with the inputs already set for "Check GPTBot and ClaudeBot Access to Your Site". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Check GPTBot and ClaudeBot Access to Your Site" task

The AI Access Audit (robots.txt + llms.txt) Actor will start running based on the input automatically. You can also change all the input fields, like site url, to match your specific use case.

Receive the "Check GPTBot and ClaudeBot Access to Your Site" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as AI crawler, purpose, verdict, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Check GPTBot and ClaudeBot Access to Your Site" task via API.