Pricing

from $1.60 / 1,000 audited pages

Try for free

Go to Apify Store

Meta Robots Auditor - Is This Page Actually Indexable?

Try for free

Indexability verdict per URL from ALL the signals: meta robots, meta googlebot, the X-Robots-Tag header (the one checkers miss), canonical + self-canonical check — with the exact reasons. Catches shipped staging noindex and CDN-injected headers. $0.002 per page vs $0.007-$0.011 measured incumbents.

Pricing

from $1.60 / 1,000 audited pages

Rating

0.0

(0)

Developer

Broke to Built

Actor stats

Bookmarked

Total users

Monthly active users

7 days ago

Last modified

Meta Robots Auditor - Is This Page Indexable? API through CLI

The Apify CLI is the official tool that allows you to use Meta Robots Auditor - Is This Page Actually Indexable? locally, providing convenience functions and automatic retries on errors.

Install Apify CLI

Using installation script (macOS/Linux):

$curl -fsSL https://apify.com/install-cli.sh | bash

Using installation script (Windows):

$irm https://apify.com/install-cli.ps1 | iex

Using Homebrew:

$brew install apify-cli

Using npm:

$npm install -g apify-cli

Other API clients include:

Meta Robots Auditor - Is This Page Actually Indexable? API in Python

Meta Robots Auditor - Is This Page Actually Indexable? API in JavaScript

Meta Robots Auditor - Is This Page Actually Indexable? OpenAPI definition

Meta Robots Auditor - Is This Page Actually Indexable? API

Robots Meta X-Robots Auditor

junipr/robots-meta-xrobots-auditor

Audit page-level robots directives from meta tags and X-Robots-Tag headers and detect conflicting indexability signals.

junipr

Indexability Audit

conserving_mastodon/indexability-audit

Can search engines index this page, and if not, why? Checks the meta robots tag, X-Robots-Tag header, canonical link, and robots.txt in one call and returns a plain verdict with the exact directive responsible. Charged only on completed audits.

Chris Arsenault

Technical SEO Site Audit Crawler - Meta, Canonical, H1, Robots

neverempty/seo-site-audit

Crawls a site and returns measured facts per page: title, meta description, canonical, meta robots and X-Robots-Tag, headings, image alt, links, JSON-LD types, hreflang, redirect chain and duplicate titles. No invented 0-100 score. Every page lists what was not checked and why.

NeverEmpty

Indexability Audit

zerobreak/indexability-audit

Indexability audit tool that checks robots.txt, meta robots tags, X-Robots-Tag headers, and canonical URLs for any list of pages, so SEO teams know which ones Google can actually crawl and index.

ZeroBreak

Robots-Noindex Conflict Checker

junipr/robots-noindex-conflict-checker

Detect conflicts between robots.txt blocking and page-level meta/X-Robots noindex signals.

junipr

SEO Indexability Checker

q_services/seo-indexability-checker

Audit pages for noindex, X-Robots-Tag, canonicals, titles, meta descriptions and H1 signals.

Q Services

Meta Tag Analyzer

scrappy_garden/meta-tag-analyzer

Analyze SEO meta tags for any list of URLs: title tag, meta description, canonical URL, robots meta, Open Graph, Twitter Cards, viewport, and hreflang. Produces a structured report with warnings and an SEO score for audits and QA.

Bikram Adhikari

Noindex Directive Validator

zerobreak/noindex-directive-validator

Noindex checker that scans URLs for meta robots and X-Robots-Tag headers, so SEO teams can find pages accidentally blocked from indexing before they drop out of search results.

ZeroBreak

SEO Meta Tags Auditor

phoenix2810/seo-meta-tags-auditor

Audit a public page's SEO and social metadata in one API call. Checks title, meta description, canonical, robots, Open Graph, Twitter Card, hreflang, viewport, and JSON-LD.

Sanskar Jaiswal

Site Launch & Migration Technical SEO Audit

burly_bat/site-launch-migration-audit

Bulk technical launch/indexability audit for a list of URLs, a sitemap or a chained dataset. Checks HTTP status, redirects, robots.txt, meta robots, X-Robots-Tag, canonical, on-page tags, JSON-LD and hreflang, then returns a PASS/WARN/FAIL verdict per URL plus a go/no-go rollup.