Google Rich Results Test, Crawling & Indexing Audit API

Instantly audit any URL or domain for Google Rich Results validation, Schema.org JSON-LD items (Organization, Product, Breadcrumbs, Logo, ContactPoint, etc.), Crawling Allowed permission, and Indexing Allowed status (meta robots noindex & X-Robots-Tag verification). Powered by direct keyless web inspection. No API Key required. 100% procedural User-Agent anti-blocking included.

---

✨ Key Features

• 📊 Google Rich Results Validation — Detects valid Schema.org rich snippet structures and entity metadata.
• 🏷️ Full Schema.org JSON-LD Tree — Extracts complete structured data objects (Organization, Product, Breadcrumbs, Logo, sameAs, contactPoint).
• 🟢 Crawl Allowed Audit — Verifies robots.txt compliance, server reachability, and HTTP status codes (crawl_allowed: "Yes" | "No").
• 🔍 Indexing Allowed Status — Detects <meta name="robots" content="noindex">, <meta name="googlebot" content="noindex">, and X-Robots-Tag HTTP response headers (indexing_allowed: "Yes" | "No").
• 🛡️ Procedural Anti-Blocking Randomization — 100% dynamic User-Agent generation on every request (Chrome, Firefox, Safari across Mac, Windows, Linux, iOS, and Android).
• 🔐 No API Keys or Auth Needed — Unthrottled keyless execution without daily Google Search Console API quota exhaustion.

---

📥 Input Parameters

Parameter	Type	Required	Default	Description
url	String	Yes	https://apify.com	Target website URL or domain to audit for Rich Results and Indexing permissions.

Input Example (JSON):

{
  "url": "https://apify.com"
}

---

📤 Output Format Example

{
  "url": "https://apify.com",
  "crawl_allowed": "Yes",
  "indexing_allowed": "Yes",
  "crawl_status": "Successful",
  "http_status": 200,
  "detected_items_count": 1,
  "is_valid_rich_result": true,
  "detected_items": [
    {
      "title": "Apify",
      "status": "check_circle",
      "type": "Organization",
      "name": "Apify",
      "legalName": "Apify Technologies s.r.o.",
      "url": "https://apify.com/",
      "logo": "https://apify.com/ext/apify-logo-120px.png",
      "sameAs": [
        "https://github.com/apify",
        "https://www.linkedin.com/company/apify",
        "https://x.com/apify",
        "https://www.youtube.com/apify",
        "https://discord.gg/w3e2v7rWDw"
      ],
      "contactPoint": [
        {
          "@type": "ContactPoint",
          "contactType": "customer support",
          "email": "support@apify.com"
        }
      ]
    }
  ],
  "google_web_ui_url": "https://search.google.com/test/rich-results?url=https%3A%2F%2Fapify.com",
  "timestamp": "2026-07-30T03:15:00.000Z"
}

---

🆚 Why Google Rich Results Audit API vs. Standard Scraping

Feature	Google Rich Results API	Standard Web Scraping / Search Console
API Key Requirement	⚡ Keyless (Zero API Key needed)	❌ Mandatory OAuth2 / Service Account required
Crawl Allowed Audit	✅ Verified (crawl_allowed: "Yes")	❌ Requires manual robots.txt parsing
Indexing Allowed Audit	✅ Verified (indexing_allowed: "Yes")	❌ Requires checking HTML meta & response headers
Structured Data (JSON-LD)	✅ Full nested schema objects	❌ Partial or unparsed raw strings
Daily Quota Limits	🚀 Unthrottled Keyless Engine	🐢 Strict Search Console 429 Rate Limits
Anti-Blocking	✅ 100% Procedural UA Randomization	❌ Single IP / Token Rate Tracking

---

💡 How To Use — Simple Workflow

1. Enter URL → Enter target website URL or domain (e.g. https://apify.com).
2. Run Audit → Click Start to execute keyless Rich Results, Crawling & Indexing validation.
3. Export Results → View detected JSON-LD items, crawling status, and indexing permissions, then export to JSON/CSV.

---

🙋 Frequently Asked Questions (FAQ)

Q: Do I need a Google Cloud account, Search Console auth, or API key?
A: No! The backend transparently executes keyless web inspection and schema extraction server-side without requiring any API key or Google credentials.

Q: How does it determine if Indexing is allowed (indexing_allowed)?
A: It automatically inspects both HTML <meta name="robots"> / <meta name="googlebot"> tags and X-Robots-Tag HTTP response headers for noindex directives.

Q: What structured data types are extracted?
A: All valid Schema.org structures including Organization, Product, BreadcrumbList, Logo, ContactPoint, sameAs social links, and custom microdata.

---

🎯 Use Cases

• 📈 SEO Audit Automation — Batch verify Rich Results, Schema markup, and indexing permissions across client websites.
• 🔍 Noindex & Crawlability Auditing — Ensure landing pages are not accidentally blocked by noindex meta tags or X-Robots-Tag headers.
• 📊 Lead Qualification & Discovery — Audit potential client domains for missing structured data or indexing issues.

---

🔍 Keywords & Tags

google rich results, rich results test, schema org, json-ld, indexing allowed, crawl allowed, seo audit, noindex checker, structured data api