This Actor‘s pricing details are outlined in the table below. The unit prices you pay depend on your Apify subscription plan, with higher tiers offering better rates. Visit our pricing page to compare plans and see how much you can save.

Pricing	Free No discount	Starter Bronze discount	Scale Silver discount	Business Gold discount

Robots txt policy auditor robots file checked	$4.90 / 1,000	$4.90 / 1,000	$4.90 / 1,000	$4.90 / 1,000
Robots txt policy auditor actor start Infrequent	$0.005	$0.005	$0.005	$0.005
Robots txt policy auditor rule parsed	$3.72 / 1,000	$3.72 / 1,000	$3.72 / 1,000	$3.72 / 1,000
Robots txt policy auditor finding emitted	$3.72 / 1,000	$3.72 / 1,000	$3.72 / 1,000	$3.72 / 1,000
Robots txt policy auditor audit report generated Infrequent	$0.05	$0.05	$0.05	$0.05
Additional costs
Platform usage	Free	Free	Free	Free

This Actor's pricing details are outlined in the table below. Visit our pricing page to compare plans and see how much you can save.

Pricing

Robots txt policy auditor robots file checked Robots Txt Policy Auditor: charged when robots file checked is completed. The price includes Apify platform usage; no separate usage pass-through is intended.	$4.90 / 1,000
Robots txt policy auditor actor startInfrequent Robots Txt Policy Auditor: charged when actor start is completed. The price includes Apify platform usage; no separate usage pass-through is intended.	$0.005
Robots txt policy auditor rule parsed Robots Txt Policy Auditor: charged when rule parsed is completed. The price includes Apify platform usage; no separate usage pass-through is intended.	$3.72 / 1,000
Robots txt policy auditor finding emitted Robots Txt Policy Auditor: charged when finding emitted is completed. The price includes Apify platform usage; no separate usage pass-through is intended.	$3.72 / 1,000
Robots txt policy auditor audit report generatedInfrequent Robots Txt Policy Auditor: charged when audit report generated is completed. The price includes Apify platform usage; no separate usage pass-through is intended.	$0.05
Additional costs
Platform usageIncluded Platform usage costs are tied to the Actor's performance in terms of the underlying platform resources it consumes. Learn more	Free

Robots.txt & AI Crawler Policy Auditor

merlin-hermes/robots-ai-crawler-policy-auditor

Parses a site's public robots.txt into structured crawler groups, allow/disallow counts, crawl delays, sitemap declarations, and explicit or inherited policies for major AI crawlers.

Sean Burke

Robots Policy Auditor

frank_conifer_af4/robots-policy-auditor

Audit robots.txt and crawl policy signals for domains before scraping, crawling, SEO checks, or data collection.

Juddroid

AI Crawler Policy Auditor

junipr/ai-crawler-policy-auditor

Audit robots and AI crawler policy signals for AI crawler access, blocking, and site-readiness.

junipr

ChatGPT Ads & AI Crawler Policy Auditor

x2ppi/ai-crawler-readiness-auditor

ChatGPT Ads landing-page policy audit: bulk-check path-specific OAI-AdsBot access, AI bot rules, llms.txt, sitemap, and metadata.

Yota

llms.txt Auditor & AI Crawler Policy Checker

zinin/llms-txt-auditor

Audit public llms.txt, llms-full.txt, and root robots.txt rules for nine named AI crawlers. Get evidence-backed presence, policy, confidence, gaps, and review actions for each complete domain audit.

Tim Zinin

AI Crawler Robots.txt Auditor

phoenix2810/ai-crawler-robots-auditor

Fetch a public website's robots.txt and report which AI crawlers (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, CCBot, Bytespider, and more) are blocked, allowed, or defaulted. Returns an AI-visibility readiness score with recommendations for GEO and AI-SEO strategy.

Sanskar Jaiswal

GEO / AEO Website Audit — AI Search Readiness

rtworule/ai-search-readiness-auditor

Audit public websites for GEO and AEO readiness: AI crawler access, robots.txt, llms.txt, sitemaps, Schema.org, social metadata, scores, and prioritized fixes.

Kunteper Koyu

RAG Dataset Builder

zinin/sitemap-to-knowledge

Turn buyer-authorized public website sitemaps into bounded, source-linked text chunks for RAG, search, migration, and review. Each delivered chunk includes provenance, hashes, crawl-gap flags, confidence, and billing metadata. Partial and homepage-fallback chunks are explicitly labeled.

Tim Zinin

Federal Website Compliance Auditor — GSA Site Scanning API

malonestar/gsa-site-scanning-auditor

Audit 29,000+ federal .gov websites via the GSA Site Scanning API. Per-agency compliance scorecards (USWDS, DAP, HTTPS/HSTS, IPv6, mobile, required links, Section 508), flat site exports and gap lists of sites missing a technology — with explicit coverage and per-scan status on every row.