Canonicalize URLs for a site migration

Created by

Daniel Craig

Actor

URL Hygiene & Dedup API

Normalize scheme, www hostnames, path slashes, query ordering, fragments, and trailing slashes before a site migration.

Try for free

URL Hygiene & Dedup APIcraigtechservicesllc/url-hygiene-dedup-api

Input index

Normalized URL

Duplicate

Duplicate of input index

+5 fields

Input

URLs:http://www.example.com//services/?b=2&a=1#overview+2

Treat HTTP and HTTPS as equal:true

Treat www and apex hostnames as equal:true

Collapse repeated path slashes:true

Remove trailing slash from non-root paths:true

Sort query parameters:true

Emit first occurrence only:true

Output fields

Input index

Normalized URL

Duplicate

Duplicate of input index

Registrable domain

Is valid

Invalid reason

Changes

Original URL

How it works

Sign up on Apify or log in

The URL Hygiene & Dedup API Actor is ready to run with the inputs already set for "Canonicalize URLs for a site migration". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Canonicalize URLs for a site migration" task

The URL Hygiene & Dedup API Actor will start running based on the input automatically. You can also change all the input fields, like URLs, treat http and https as equal, and more, to match your specific use case.

Receive the "Canonicalize URLs for a site migration" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as input index, normalized url, duplicate, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Canonicalize URLs for a site migration" task via API.