Pricing

$20.00 / 1,000 page scanneds

Meta Robots Checker - Is This Page Indexable? API

Check if a page is indexable by search engines. Input: a URL. Output: JSON with meta robots content, X-Robots-Tag header, canonical URL and self-reference check, noindex/nofollow flags, and a combined indexable verdict. Cheap pay-per-result: $0.02 per page scanned.

Pricing

$20.00 / 1,000 page scanneds

Rating

0.0

(0)

Developer

Anthony Snider

Actor stats

Bookmarked

Total users

Monthly active users

3 days ago

Last modified

Meta Robots & Indexability Auditor

Find out instantly whether a page can actually rank — or is quietly blocked from Google's index.

Live on the Apify Store — run it instantly or call it as an agent tool via Apify MCP.

This actor fetches a page, reads every signal search engines use to decide indexability — the meta name="robots" tag, the per-bot meta name="googlebot" tag, the X-Robots-Tag HTTP header, and the rel="canonical" link — then combines them into one clear indexable verdict with plain-English reasons.

What you get

indexable verdict — a single boolean: will this page be indexed, or is it blocked?
All robots sources — metaRobots, metaGooglebot, and the xRobotsTag header, exactly as served.
Parsed directives — noindex, nofollow, noarchive, nosnippet, noimageindex, plus the full normalized list.
Canonical check — the declared canonical URL and whether it self-references (or points elsewhere = duplicate risk).
Reasons — human-readable explanations behind the verdict, so you know exactly what to fix.
Bulk — audit up to 50 URLs in a single run.

Input

{
  "url": "https://github.com",
  "urls": ["https://www.cloudflare.com", "example.com/blog"],
  "maxUrls": 25
}

Provide a single url, a list of urls, or both. Domains without a scheme default to https://.

Output

{
  "url": "https://github.com",
  "finalUrl": "https://github.com/",
  "status": 200,
  "indexable": true,
  "metaRobots": null,
  "metaGooglebot": null,
  "xRobotsTag": null,
  "directives": {
    "noindex": false,
    "nofollow": false,
    "noarchive": false,
    "nosnippet": false,
    "noimageindex": false,
    "none": false,
    "all": []
  },
  "canonical": "https://github.com/",
  "selfCanonical": true,
  "reasons": [
    "No robots restrictions found — defaults to indexable & followable.",
    "canonical is self-referential."
  ]
}

Robots-Noindex Conflict Checker

junipr/robots-noindex-conflict-checker

Detect conflicts between robots.txt blocking and page-level meta/X-Robots noindex signals.

junipr

Site Launch & Migration Technical SEO Audit

burly_bat/site-launch-migration-audit

Bulk technical launch/indexability audit for a list of URLs, a sitemap or a chained dataset. Checks HTTP status, redirects, robots.txt, meta robots, X-Robots-Tag, canonical, on-page tags, JSON-LD and hreflang, then returns a PASS/WARN/FAIL verdict per URL plus a go/no-go rollup.

Burly Bat

Noindex Directive Validator

zerobreak/noindex-directive-validator

Noindex checker that scans URLs for meta robots and X-Robots-Tag headers, so SEO teams can find pages accidentally blocked from indexing before they drop out of search results.

ZeroBreak

SEO Indexability Checker

q_services/seo-indexability-checker

Audit pages for noindex, X-Robots-Tag, canonicals, titles, meta descriptions and H1 signals.

Q Services

SEO Audit Tool: Title, Meta, Schema, Robots, Sitemap

eliai/website-seo-tech-auditor

SEO audit for any URL: pass a page URL, get one structured JSON report â€” title/meta tags, heading structure, schema markup, robots.txt, sitemap, canonical, and performance basics. Machine-readable output for agents and pipelines; pay only per audited URL.

Anthony Snider

Mobile-Friendly Checker - Test Any Page, No Browser Needed

eliai/webpage-mobile-friendly-checker

Check mobile-friendliness signals on any page without a headless browser. Input: a URL. Output: JSON with viewport meta presence and content, responsive tags, tap-target and font hints, fixed-width elements, and Flash/legacy usage flags. $0.02 per page scanned.

Anthony Snider

Keyword Density Checker API — Top Terms for Any URL

eliai/webpage-keyword-density

Check keyword density via API. Input: a page URL. Output: JSON of top 1-3 word phrases with counts and density percentages — the on-page SEO signal writers and agents optimize against. Cheap pay-per-result: $0.02 per page scanned.

Anthony Snider

Indexability Audit

zerobreak/indexability-audit

Indexability audit tool that checks robots.txt, meta robots tags, X-Robots-Tag headers, and canonical URLs for any list of pages, so SEO teams know which ones Google can actually crawl and index.

ZeroBreak

Bulk URL Status Checker

fetch_cat/bulk-url-status-checker

Check large URL lists for status codes, redirects, broken links, response timing, headers, titles, canonical URLs, and robots meta.

Hanna Nosova

Meta Tag Analyzer

scrappy_garden/meta-tag-analyzer

Analyze SEO meta tags for any list of URLs: title tag, meta description, canonical URL, robots meta, Open Graph, Twitter Cards, viewport, and hreflang. Produces a structured report with warnings and an SEO score for audits and QA.