AI Search (GEO / AEO), llms.txt & Markdown Generator avatar

AI Search (GEO / AEO), llms.txt & Markdown Generator

Pricing

from $10.00 / 1,000 page auditeds

Go to Apify Store
AI Search (GEO / AEO), llms.txt & Markdown Generator

AI Search (GEO / AEO), llms.txt & Markdown Generator

Audit websites for AI search visibility (GEO/AEO): checks llms.txt, GPTBot/ClaudeBot/PerplexityBot robots.txt policies, Schema.org JSON-LD, and exports ready-to-commit llms.txt & llms-full.txt Markdown bundles.

Pricing

from $10.00 / 1,000 page auditeds

Rating

0.0

(0)

Developer

Cipiwon Daisuki

Cipiwon Daisuki

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

2 hours ago

Last modified

Features

Limited permissions

Share

AI Search (GEO / AEO), llms.txt & Markdown Generator

Audit any public website for Generative Engine Optimization (GEO), Answer Engine Optimization (AEO), and AI Search Visibility, inspect AI crawler rules (GPTBot, ClaudeBot, PerplexityBot), validate Schema.org JSON-LD, and generate ready-to-commit llms.txt and llms-full.txt Markdown bundles in seconds.

Built for technical SEOs, AI product builders, agencies, and RAG pipelines searching for llms.txt, geo audit, aeo checker, ai search visibility, schema markup audit, and website to markdown llm.


Why Use This Actor?

  • ⚡ Ultra-Fast HTTP-Only Engine: Uses CheerioCrawler (crawlee + cheerio + turndown) with zero browser spin-up overhead — faster runs and minimal compute usage.
  • 🤖 Full AI Crawler Matrix (robots.txt): Checks explicit & wildcard rules for GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Anthropic-ai, PerplexityBot, Google-Extended, and CCBot.
  • 📄 Ready-to-Commit llms.txt & llms-full.txt: Strips navigation, headers, footers, scripts, and SVGs to produce clean LLM-ready Markdown following the llmstxt.org specification.
  • 📊 Actionable 0–100 AI-Readiness Score: Audits <title>, <meta name="description">, <link rel="canonical">, <h1>, OpenGraph, Twitter Cards, and malformed Schema.org JSON-LD.

Input Example ("Try Me" Default)

{
"startUrl": "https://example.com",
"maxPages": 10,
"generateLlmsTxt": true,
"generateLlmsFullTxt": true,
"maxMarkdownCharsPerPage": 12000
}

Free Plan vs. Paid Apify Plan

TierMax Pages Per RunOutputs Included
Free Apify Plan (Demo)Up to 3 pagesFull dataset + SUMMARY.json + llms.txt + llms-full.txt
Paid Apify PlanUp to 100 pagesFull site audit, batch llms-full.txt & prioritized recommendations

Output Artifacts & Sample JSON

  1. Dataset (default) — One structured JSON item per audited page:
{
"url": "https://example.com/",
"statusCode": 200,
"title": "Example Domain",
"hasCanonical": false,
"hasJsonLd": false,
"jsonLdTypes": [],
"wordCount": 25,
"pageScore": 20,
"issues": ["missing_meta_description", "missing_canonical", "missing_h1", "missing_json_ld"]
}
  1. Key-Value Store (SUMMARY.json): Site-wide aiReadinessScore (0–100), aiCrawlerPolicies, /llms.txt & /sitemap.xml checks, and prioritized fixes.
  2. Key-Value Store (llms.txt): Ready-to-deploy llmstxt.org Markdown index.
  3. Key-Value Store (llms-full.txt): Combined Markdown content bundle ready for RAG / LLM context windows.

Pay-Per-Event (PPE) Pricing

EventPriceWhen Charged
page-audited$0.01Once per HTML page audited and converted to Markdown ($10 / 1,000 pages)
llms-txt-bundle-generated$0.03Once per run when SUMMARY.json, llms.txt, and llms-full.txt are generated

🤖 Use with AI Agents (MCP), n8n & REST API

This Actor runs under Limited Permissions with structured Input/Output schemas so AI agents on mcp.apify.com (Cursor, Claude, Windsurf) and workflow tools (n8n, Make, Zapier) can invoke sadis/geo-llms-ai-readiness-auditor directly:

curl -X POST "https://api.apify.com/v2/acts/sadis~geo-llms-ai-readiness-auditor/run-sync-get-dataset-items?token=YOUR_APIFY_TOKEN" \
-H "Content-Type: application/json" \
-d '{"startUrl":"https://example.com","maxPages":10}'

FAQ

Q: Does this Actor bypass logins or anti-bot walls?
A: No. It inspects public HTTP endpoints (robots.txt, sitemap.xml, llms.txt, and public HTML) that websites want search engines and AI assistants to index.

Q: Why was my Free-plan run capped at 3 pages?
A: Free Apify accounts get a 3-page demo run so you can test the full output format at $0. Paid Apify accounts unlock up to 100 pages per run at $0.01/page.