Check noindex, canonical and indexability of URLs in bulk

Created by

Yukai Lin

Actor

Bulk URL Status Checker - HTTP Status & 301 Redirect Checker

For each URL, get the status code plus the page title, canonical URL, meta robots and X-Robots-Tag, and a clear indexable yes/no. The example checks python.org, the Python docs, GitHub, Wikipedia and BBC News. Use it to find pages accidentally set to noindex or pointing their canonical elsewhere before they drop out of Google.

Try for free

Bulk URL Status Checker - HTTP Status & 301 Redirect Checkertidytools/bulk-url-status-checker

URL

Status

Final URL

Ssl days left

+11 fields

Input

URLs:https://www.python.org/+6

Read canonical, meta robots and title:true

Output fields

URL

Status

Final URL

Ssl days left

Ssl valid to

Ssl issuer

SSL valid

Expiring soon

Ssl error

Indexable

Not indexable reason

Canonical

Canonical = final URL

Meta robots

Title

How it works

Sign up on Apify or log in

The Bulk URL Status Checker - HTTP Status & 301 Redirect Checker Actor is ready to run with the inputs already set for "Check noindex, canonical and indexability of URLs in bulk". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Check noindex, canonical and indexability of URLs in bulk" task

The Bulk URL Status Checker - HTTP Status & 301 Redirect Checker Actor will start running based on the input automatically. You can also change all the input fields, like URLs and read canonical, meta robots and title, to match your specific use case.

Receive the "Check noindex, canonical and indexability of URLs in bulk" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as URL, status, final url, and more.