Public AI Crawler Policy Signal Agent
Pricing
from $5.00 / 1,000 useful ai crawler policy results
Analyze public robots.txt and llms.txt files for AI crawler allow/block policy evidence, LLM guidance files, stable hashes, and useful-result pricing.
You can access the Public AI Crawler Policy Signal Agent programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in API & Integrations in Apify Console.
$echo '{}' |<apify call jacksu/public-ai-crawler-policy-signal-agent --silent --output-datasetThe Apify CLI is the official tool that allows you to use Public AI Crawler Policy Signal Agent locally, providing convenience functions and automatic retries on errors.
Using installation script (macOS/Linux):
$curl -fsSL https://apify.com/install-cli.sh | bashUsing installation script (Windows):
$irm https://apify.com/install-cli.ps1 | iexUsing Homebrew:
$brew install apify-cliUsing npm:
$npm install -g apify-cliOther API clients include: