Pricing

from $3.90 / 1,000 item processeds

Go to Apify Store

Robots-Noindex Conflict Checker

Try for free

Detect conflicts between robots.txt blocking and page-level meta/X-Robots noindex signals.

Pricing

from $3.90 / 1,000 item processeds

Rating

0.0

(0)

Developer

junipr

Actor stats

Bookmarked

Total users

Monthly active users

6 days ago

Last modified

Categories

SEO tools

Input items

inputItems

Optional

Actor-specific records or URLs to process.

Type:array

Domains

domains

Optional

Domain fixture records or domain strings.

Type:array

URLs

urls

Optional

URL fixture records or URL strings.

Type:array

Maximum items

maxItems

Optional

Hard cap for processed items.

Type:integer

Minimum:1

Maximum:10000

Default:50

Maximum domains

maxDomains

Optional

Hard cap for processed domains.

Type:integer

Minimum:1

Maximum:10000

Default:50

Timeout per item

timeoutMs

Optional

Local/live request timeout cap in milliseconds.

Type:integer

Minimum:500

Maximum:60000

Default:5000

Include report

includeReport

Optional

Write KVS Markdown and JSON report outputs.

Type:boolean

Default:true

Include summary

includeSummary

Optional

Write summary KVS output.

Type:boolean

Default:true

Strict mode

strictMode

Optional

Use stricter validation thresholds.

Type:boolean

Default:false

Fixture mode

fixtureMode

Optional

Use local deterministic fixtures. Live lookups remain off by default.

Type:boolean

Default:true

Maximum charge USD

maxChargeUsd

Optional

Local PPE guard cap before paid rows stop gracefully.

Type:number

Minimum:0.01

Maximum:100

Default:1

U R Ls

URLs

Optional

Actor-specific input seed: URLs.

Type:string

Noindex Directive Validator

zerobreak/noindex-directive-validator

Noindex checker that scans URLs for meta robots and X-Robots-Tag headers, so SEO teams can find pages accidentally blocked from indexing before they drop out of search results.

ZeroBreak

SEO Indexability Checker

q_services/seo-indexability-checker

Audit pages for noindex, X-Robots-Tag, canonicals, titles, meta descriptions and H1 signals.

Q Services

robots.txt Analyzer

eliai/robots-txt-analyzer

Anthony Snider

Robots.txt Analyzer

mahogany_songbird/robots-txt-analyzer

Read robots.txt disallow rules and sitemap declarations.

Britton Furness

Robots Indexability Audit

toronto_777/robots-indexability-audit

Audit public robots.txt, sitemap declarations, homepage robots directives, and crawler allow/block signals for SEO and AI visibility checks.

Steven Feng

Robots.txt Validator

predictable_function/my-actor-3

List of website base URLs whose robots.txt files will be validated

riya rawat

5.0

Store/Crawler Surface Preflight

checksmithcats/store-crawler-surface-preflight

Cross-check public robots.txt, sitemap, noindex, llms.txt, policy links, and contact signals from a storefront URL. Reads only public URLs; no account access.

Checksmith Cats

Indexability Audit

zerobreak/indexability-audit

Indexability audit tool that checks robots.txt, meta robots tags, X-Robots-Tag headers, and canonical URLs for any list of pages, so SEO teams know which ones Google can actually crawl and index.

ZeroBreak