Pricing

from $1.60 / 1,000 audited pages

Try for free

Go to Apify Store

Meta Robots Auditor - Is This Page Actually Indexable?

Try for free

Indexability verdict per URL from ALL the signals: meta robots, meta googlebot, the X-Robots-Tag header (the one checkers miss), canonical + self-canonical check — with the exact reasons. Catches shipped staging noindex and CDN-injected headers. $0.002 per page vs $0.007-$0.011 measured incumbents.

Pricing

from $1.60 / 1,000 audited pages

Rating

0.0

(0)

Developer

Broke to Built

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Configure MCP server with Meta Robots Auditor - Is This Page Indexable?

The configuration above connects to the hosted Apify MCP server with the Meta Robots Auditor - Is This Page Indexable? Actor already loaded. It uses OAuth, so your client opens a browser window to sign you in to Apify on first use. No API token is needed. Clients without OAuth support can authenticate with an Authorization: Bearer header carrying an API token from API & Integrations in Apify Console.

Get a ready-to-use configuration for your MCP client with the Meta Robots Auditor - Is This Page Indexable? Actor preconfigured at https://mcp.apify.com/?tools=fetch-actor-details,eliai/webpage-meta-robots-auditor.

You can connect to the Apify MCP Server using clients like Tester MCP Client, or any other MCP client of your choice.

If you want to learn more about our Apify MCP implementation, check out our MCP documentation. To learn more about the Model Context Protocol in general, refer to the official MCP documentation or read our blog post.

Robots Meta X-Robots Auditor

junipr/robots-meta-xrobots-auditor

Audit page-level robots directives from meta tags and X-Robots-Tag headers and detect conflicting indexability signals.

junipr

Indexability Audit

conserving_mastodon/indexability-audit

Can search engines index this page, and if not, why? Checks the meta robots tag, X-Robots-Tag header, canonical link, and robots.txt in one call and returns a plain verdict with the exact directive responsible. Charged only on completed audits.

Chris Arsenault

Technical SEO Site Audit Crawler - Meta, Canonical, H1, Robots

neverempty/seo-site-audit

Crawls a site and returns measured facts per page: title, meta description, canonical, meta robots and X-Robots-Tag, headings, image alt, links, JSON-LD types, hreflang, redirect chain and duplicate titles. No invented 0-100 score. Every page lists what was not checked and why.

NeverEmpty

Indexability Audit

zerobreak/indexability-audit

Indexability audit tool that checks robots.txt, meta robots tags, X-Robots-Tag headers, and canonical URLs for any list of pages, so SEO teams know which ones Google can actually crawl and index.

ZeroBreak

Robots-Noindex Conflict Checker

junipr/robots-noindex-conflict-checker

Detect conflicts between robots.txt blocking and page-level meta/X-Robots noindex signals.

junipr

SEO Indexability Checker

q_services/seo-indexability-checker

Audit pages for noindex, X-Robots-Tag, canonicals, titles, meta descriptions and H1 signals.

Q Services

Meta Tag Analyzer

scrappy_garden/meta-tag-analyzer

Analyze SEO meta tags for any list of URLs: title tag, meta description, canonical URL, robots meta, Open Graph, Twitter Cards, viewport, and hreflang. Produces a structured report with warnings and an SEO score for audits and QA.

Bikram Adhikari

Noindex Directive Validator

zerobreak/noindex-directive-validator

Noindex checker that scans URLs for meta robots and X-Robots-Tag headers, so SEO teams can find pages accidentally blocked from indexing before they drop out of search results.

ZeroBreak

SEO Meta Tags Auditor

phoenix2810/seo-meta-tags-auditor

Audit a public page's SEO and social metadata in one API call. Checks title, meta description, canonical, robots, Open Graph, Twitter Card, hreflang, viewport, and JSON-LD.

Sanskar Jaiswal

Site Launch & Migration Technical SEO Audit

burly_bat/site-launch-migration-audit

Bulk technical launch/indexability audit for a list of URLs, a sitemap or a chained dataset. Checks HTTP status, redirects, robots.txt, meta robots, X-Robots-Tag, canonical, on-page tags, JSON-LD and hreflang, then returns a PASS/WARN/FAIL verdict per URL plus a go/no-go rollup.