Pricing

$18.00 / 1,000 audited sites

AI Bot & LLM Crawler Exposure Auditor

Audit robots.txt, llms.txt, AI crawler directives, public content exposure, and policy gaps for websites in the AI search era.

Pricing

$18.00 / 1,000 audited sites

Rating

0.0

(0)

Developer

Ushba Khan

Actor stats

Bookmarked

Total users

Monthly active users

11 hours ago

Last modified

AI Bot & LLM Crawler Exposure Auditor API through CLI

The Apify CLI is the official tool that allows you to use AI Bot & LLM Crawler Exposure Auditor locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

AI Bot & LLM Crawler Exposure Auditor API in Python

AI Bot & LLM Crawler Exposure Auditor API in JavaScript

AI Bot & LLM Crawler Exposure Auditor OpenAPI definition

AI Bot & LLM Crawler Exposure Auditor API

♿ ADA Website Compliance Checker — WCAG Scanner

upstanding_biobot/ada-wcag-compliance-scan

Check any website for ADA/WCAG violations in seconds. 90+ axe-core rules, compliance score, lawsuit risk, element-level details. Bulk scan hundreds of sites. $2/scan, no subscription.

Alexander Maksimchuk

Ad Pixel Id Extractor

trovevault/ad-pixel-id-extractor

Extract advertising pixel IDs from any website. Get the actual pixel ID values for Facebook Pixel, TikTok Pixel, Google Ads, Google Analytics, GTM, LinkedIn, Pinterest, Snapchat, Twitter/X, Bing Ads, HotJar, Criteo, Klaviyo, Segment, Heap, and Mixpanel from a plain list of URLs.

Trove Vault

Agency Directory Scraper & Lead Finder

ryanclinton/agency-directory-scraper

Scrapes marketing, design, and tech agencies from Google Maps, SuperbCompanies.com, and TheManifest.com into one deduplicated dataset. Extracts name, website, phone, address, services, team size, and rating. $0.05/agency.

Ryan Clinton

Etsy Sales Intelligence

marielise.dev/etsy-sales-intelligence

Estimate hidden Etsy lifetime sales and revenue from any listing, shop, or keyword. Reverse-engineers per-listing units sold using public signals, AI translation, and adaptive confidence bands. $0.05 per listing analysed. The Etsy seller intelligence estimator.

Marielise

AI Crawler Readiness Auditor

nectared_screen/ai-crawler-readiness-auditor

Audit domains for llms.txt, robots.txt AI bot rules, sitemap hints, and public AI crawler readiness signals.

jaehan byun

GEO & llms.txt Readiness Auditor

gp005/geo-llms-auditor

Audit which AI crawlers (GPTBot, ClaudeBot, PerplexityBot, Googlebot, and 30+ more) your site allows or blocks, validate your llms.txt, and score AI-citability — with an exact prioritized fix list. Non-scraper, reads public well-known files.

Geo

GEO Auditor — AI Search Readiness & Citability Audit

foxlabs/geo-auditor

Audit how ready your site is to be found, read & cited by AI search (ChatGPT, Perplexity, Gemini, Claude). Checks AI-crawler access, structured data, content extractability, speed & trust — scored 0-100 with a prioritized fix list. GEO / AEO technical audit.

Berkan Kaplan

SEC EDGAR Scraper

constructive_calm/sec-edgar-scraper

Fetches SEC EDGAR filings, normalized financial statements, XBRL facts, insider trades (Form 4), institutional holdings (13F), activist stakes (13D/G), full-text search hits, and parsed 8-K items via official SEC APIs. Zero anti-bot. Optional AI summaries.

Omar Eldeeb

5.0

(1)

GEO Competitive Benchmark — AI Search Readiness vs Competitors

foxlabs/geo-benchmark

Benchmark your site vs up to 5 competitors for AI-search readiness in one run. See where rivals out-rank you for ChatGPT, Perplexity, Gemini & Claude citation — AI-crawler access, schema, extractability, speed, trust — as a ranked scoreboard + per-signal gap list. Deterministic GEO/AEO.

Berkan Kaplan

SEC EDGAR Intel - 8-K Triggers, Form 4 Patterns, Form D Funding

seibs.co/sec-edgar-intel

SEC filings intelligence. 8-K trigger classifier (M&A/exec-change/going-concern/etc), Form 4 insider patterns (cluster buys, unusual size), 13F position tracker, Form D startup raises, earnings transcript extraction. For hedge funds, fintech, due diligence, journalists.