Clean and deduplicate tracking URLs

Created by

Daniel Craig

Actor

URL Hygiene & Dedup API

Normalize URLs, remove common tracking parameters and fragments, and return one deterministic record per unique destination.

Try for free

URL Hygiene & Dedup APIcraigtechservicesllc/url-hygiene-dedup-api

Input index

Normalized URL

Duplicate

Duplicate of input index

+5 fields

Input

URLs:https://example.com/products/?utm_source=newsletter&utm_campaign=spring#details+2

Remove known tracking parameters:true

Remove URL fragments:true

Sort query parameters:true

Remove trailing slash from non-root paths:true

Emit first occurrence only:true

Output fields

Input index

Normalized URL

Duplicate

Duplicate of input index

Registrable domain

Is valid

Invalid reason

Changes

Original URL

How it works

Sign up on Apify or log in

The URL Hygiene & Dedup API Actor is ready to run with the inputs already set for "Clean and deduplicate tracking URLs". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Clean and deduplicate tracking URLs" task

The URL Hygiene & Dedup API Actor will start running based on the input automatically. You can also change all the input fields, like URLs, remove known tracking parameters, and more, to match your specific use case.

Receive the "Clean and deduplicate tracking URLs" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as input index, normalized url, duplicate, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Clean and deduplicate tracking URLs" task via API.