Pricing

from $200.00 / 1,000 completed website intelligence scans

Try for free

Go to Apify Store

AI Website Intelligence Scanner

Try for free

Analyze a website's AI readiness, crawler policy, API surface, documentation, and machine-readable structure in one run.

Pricing

from $200.00 / 1,000 completed website intelligence scans

Rating

0.0

(0)

Developer

Sentinel Signal

Actor stats

Bookmarked

Total users

Monthly active users

4 days ago

Last modified

Bulk AI Readiness Scanner

bmiller1009/bulk-ai-readiness-scanner

Score many domains for AI agent readiness in one run.

Sentinel Signal

AI Crawler Policy Auditor

junipr/ai-crawler-policy-auditor

Audit robots and AI crawler policy signals for AI crawler access, blocking, and site-readiness.

junipr

AI Readiness Checker - Website Scanner

alizarin_refrigerator-owner/ai-readiness-checker

Analyze any website for AI optimization readiness. Check robots.txt, llms.txt, structured data, meta tags & content quality. Get actionable recommendations to improve AI crawler accessibility.

The Howlers

Bulk AI Crawler Policy Checker

bmiller1009/bulk-ai-crawler-policy-checker

Check many domains' robots.txt AI crawler policy in one run.

Sentinel Signal

AI Website Content Crawler

ilborso/ai-website-content-crawler

A super fast website crawler for Agentic AI integration

Fabio Borsotti

Website Content Crawler

rupom888/website-content-crawler

Syed Rupom

Website Content Crawler

admo-solutions/website-content-crawler

Admo Solutions

Website Intelligence API

ib4ngz/website-intelligence-api

Analyze website technologies, comments, structured data, robots.txt, and sitemaps in one run.

Iqbal R

AI Crawler Readiness Auditor

nectared_screen/ai-crawler-readiness-auditor

Audit domains for llms.txt, robots.txt AI bot rules, sitemap hints, and public AI crawler readiness signals.

jaehan byun

AI Readiness Auditor

rationalistic_counsel/ai-readiness-auditor

Check how AI-ready any website is. Get an AI Readiness Score (0-100) checking llms.txt, robots.txt AI crawler directives, Schema.org structured data, and meta tags. No API key needed.