Pricing

from $0.50 / 1,000 results

URL Hygiene & Dedup API

Normalize and deduplicate URL lists before crawling, enrichment, analytics, or RAG. Remove tracking parameters, sort queries, flag invalid URLs, and group duplicate links without fetching target websites.

Pricing

from $0.50 / 1,000 results

Rating

0.0

(0)

Developer

Daniel Craig

Actor stats

Bookmarked

Total users

Monthly active users

5 days ago

Last modified

Configure MCP server with URL Hygiene & Dedup API

The configuration above connects to the hosted Apify MCP server with the URL Hygiene & Dedup API Actor already loaded. It uses OAuth, so your client opens a browser window to sign you in to Apify on first use. No API token is needed. Clients without OAuth support can authenticate with an Authorization: Bearer header carrying an API token from API & Integrations in Apify Console.

Get a ready-to-use configuration for your MCP client with the URL Hygiene & Dedup API Actor preconfigured at https://mcp.apify.com/?tools=fetch-actor-details,craigtechservicesllc/url-hygiene-dedup-api.

You can connect to the Apify MCP Server using clients like Tester MCP Client, or any other MCP client of your choice.

If you want to learn more about our Apify MCP implementation, check out our MCP documentation. To learn more about the Model Context Protocol in general, refer to the official MCP documentation or read our blog post.

Domain List Cleaner — Normalize & Dedupe URLs

night111/domain-list-cleaner

Clean messy domain and URL lists: normalize, strip paths, remove social-only hosts, dedupe. Perfect prep step before contact enrichment.

ng. night

5.0

Superclean URLs

superlativetech/superclean-urls

Clean messy URLs from lead exports. Remove 60+ tracking parameters (utm_*, fbclid, gclid), normalize format, extract domains, and optionally verify URLs are reachable. Perfect for cold email personalization and CRM data hygiene.

Superlative

Glassdoor Jobs | Remove Duplicate Jobs | Cheapest

cheap_scraper/glassdoor-jobs-scraper-remove-duplicate-jobs

Glassdoor Jobs | Remove Duplicate Jobs | Cheapest The Glassdoor jobs scraper allows you to collect jobs By entering multiple keywords, search queries.

cheap_scraper

2.5K

LinkedIn Jobs Scraper | Remove Duplicate Jobs | Pay Per Result

cheap_scraper/linkedin-job-scraper

LinkedIn Jobs Scraper | Remove Duplicate Jobs. The LinkedIn jobs scraper allows you to collect jobs in 2 ways: By providing one or more start URLs, or By entering multiple keywords, search queries. You can use either method individually or combine both.

cheap_scraper

45K

4.6

Tender Opportunity Intelligence

atlas-data/tender-opportunity-intelligence

Normalize, deduplicate, rank, and track EU procurement opportunities from TED.

Atlas

Indeed Jobs Scraper | Remove Duplicate Jobs

cheap_scraper/indeed-job-scraper

The Indeed job scraper allows you to collect jobs by entering keyword-based search queries.

cheap_scraper

3.4K

1.1

Product Feed Validator

gifted_wagon/product-feed-validator

Catch missing fields, invalid prices, duplicate IDs, inconsistent variants, and Google Merchant feed risks before import.

Michael Olmos

Lead List QA Report

junipr/lead-list-qa-report

Audit lead lists for duplicates, missing domains, invalid contact fields, and delivery readiness without enrichment.

junipr

Facebook Group Posts Scraper

khadinakbar/facebook-group-posts-scraper

Scrape public Facebook group posts by group URL or group ID. Export post text, author, reaction/comment/share counts, media URLs, top comments, and pagination cursors. No login or cookies required. MCP/API-ready.

Khadin Akbar

CSV Deduper Normalizer

junipr/csv-deduper-normalizer

Deduplicate and normalize CSV-style rows. Clean whitespace, casing, domains, URLs, and emails, then output kept and duplicate rows plus clean CSV/JSON files.

junipr