Pricing

from $3.90 / 1,000 item processeds

Go to Apify Store

Robots-Noindex Conflict Checker

Try for free

Detect conflicts between robots.txt blocking and page-level meta/X-Robots noindex signals.

Pricing

from $3.90 / 1,000 item processeds

Rating

0.0

(0)

Developer

junipr

Actor stats

Bookmarked

Total users

Monthly active users

6 days ago

Last modified

Categories

SEO tools

Url

url

Optional

Robots-Noindex Conflict Checker output field: url.

Type:string

Robots Url

robotsUrl

Optional

Robots-Noindex Conflict Checker output field: robotsUrl.

Type:string

Status Code

statusCode

Optional

Robots-Noindex Conflict Checker output field: statusCode.

Type:number

User Agent

userAgent

Optional

Robots-Noindex Conflict Checker output field: userAgent.

Type:string

Directive Type

directiveType

Optional

Robots-Noindex Conflict Checker output field: directiveType.

Type:string

Directive Value

directiveValue

Optional

Robots-Noindex Conflict Checker output field: directiveValue.

Type:string

Issue Type

issueType

Optional

Robots-Noindex Conflict Checker output field: issueType.

Type:string

Severity

severity

Optional

Robots-Noindex Conflict Checker output field: severity.

Type:string

Evidence

evidence

Optional

Robots-Noindex Conflict Checker output field: evidence.

Type:string

Recommendation

recommendation

Optional

Robots-Noindex Conflict Checker output field: recommendation.

Type:string

Other properties may be included.

Noindex Directive Validator

zerobreak/noindex-directive-validator

Noindex checker that scans URLs for meta robots and X-Robots-Tag headers, so SEO teams can find pages accidentally blocked from indexing before they drop out of search results.

ZeroBreak

SEO Indexability Checker

q_services/seo-indexability-checker

Audit pages for noindex, X-Robots-Tag, canonicals, titles, meta descriptions and H1 signals.

Q Services

robots.txt Analyzer

eliai/robots-txt-analyzer

Anthony Snider

Robots.txt Analyzer

mahogany_songbird/robots-txt-analyzer

Read robots.txt disallow rules and sitemap declarations.

Britton Furness

Robots Indexability Audit

toronto_777/robots-indexability-audit

Audit public robots.txt, sitemap declarations, homepage robots directives, and crawler allow/block signals for SEO and AI visibility checks.

Steven Feng

Robots.txt Validator

predictable_function/my-actor-3

List of website base URLs whose robots.txt files will be validated

riya rawat

5.0

Store/Crawler Surface Preflight

checksmithcats/store-crawler-surface-preflight

Cross-check public robots.txt, sitemap, noindex, llms.txt, policy links, and contact signals from a storefront URL. Reads only public URLs; no account access.

Checksmith Cats

Indexability Audit

zerobreak/indexability-audit

Indexability audit tool that checks robots.txt, meta robots tags, X-Robots-Tag headers, and canonical URLs for any list of pages, so SEO teams know which ones Google can actually crawl and index.

ZeroBreak