Pricing

from $5.00 / 1,000 results

Text Dedupe — exact & near-duplicate detection, Japanese ready

Detect exact and near-duplicate texts in scraped or collected datasets: normalized hashing for exact matches plus character-shingle Jaccard similarity for near matches. Works on Japanese (no word tokenization needed). Returns per-text verdicts and duplicate clusters. No LLM cost.

Pricing

from $5.00 / 1,000 results

Rating

0.0

(0)

Developer

Shinobu Otani

Actor stats

Bookmarked

Total users

Monthly active users

2 days ago

Last modified

Categories

Developer tools

You can access the Text Dedupe — exact & near-duplicate detection, Japanese ready programmatically from your own applications by using the Apify API. You can also choose the language preference from below. To use the Apify API, you’ll need an Apify account and your API token, found in Integrations settings in Apify Console.

Python

JavaScript

CLI

OpenAPI

HTTP

MCP

1from apify_client import ApifyClient
2
3# Initialize the ApifyClient with your Apify API token
4# Replace '<YOUR_API_TOKEN>' with your token.
5client = ApifyClient("<YOUR_API_TOKEN>")
6
7# Prepare the Actor input
8run_input = { "texts": [
9        "The quick brown fox jumps over the lazy dog.",
10        "The quick brown fox jumps over the lazy dog!",
11        "An entirely different sentence about something else.",
12    ] }
13
14# Run the Actor and wait for it to finish
15run = client.actor("shoebill-dev27/text-dedupe").call(run_input=run_input)
16
17# Fetch and print Actor results from the run's dataset (if there are any)
18print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
19for item in client.dataset(run["defaultDatasetId"]).iterate_items():
20    print(item)
21
22# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

Text Dedupe — exact & near-duplicate detection, Japanese ready API in Python

The Apify API client for Python is the official library that allows you to use Text Dedupe — exact & near-duplicate detection, Japanese ready API in Python, providing convenience functions and automatic retries on errors.

Install the apify-client

$pip install apify-client

Other API clients include:

Text Dedupe — exact & near-duplicate detection, Japanese ready API in JavaScript

Text Dedupe — exact & near-duplicate detection, Japanese ready API through CLI

Text Dedupe — exact & near-duplicate detection, Japanese ready OpenAPI definition

Text Dedupe — exact & near-duplicate detection, Japanese ready API

Lead Scraper & Email Finder - Decision Makers

painless_tweet/leadslogix-pipeline

Upload a company list, get verified decision maker emails, phones, LinkedIn, and social profiles. 12-stage pipeline: website discovery, contact extraction, email finder, verification, social enrichment, lead scoring, and Excel export. For email marketing, cold outreach, and B2B prospecting.

Leadslogix LLC

5.0

(3)

Knowledge Intelligence Engine — Website to Markdown for RAG

ryanclinton/website-content-to-markdown

Turn any website, documentation site or help centre into a retrieval-ready knowledge corpus for RAG and AI search. Clean Markdown plus chunks, change detection, deduplication, retrieval scoring, version awareness and a full corpus audit, in one run.

Ryan Clinton

Hacker News Search — Stories, Comments & Developer Sentiment

ryanclinton/hackernews-search

Search and extract stories, comments, polls, Show HN, and Ask HN posts from Hacker News. This actor uses the Algolia HN Search API to find content by keyword, filter by author, date range, minimum points, and comment count -- then returns clean, structured JSON ready for analysis, monitoring, or ...

Ryan Clinton

Nominatim Address Geocoder

ryanclinton/nominatim-geocoder

Batch geocode addresses to GPS coordinates (forward geocoding) or convert latitude/longitude coordinates back to street addresses (reverse geocoding) using the OpenStreetMap Nominatim API. Powered by the world's largest open geographic database with global coverage across 200+ countries.

Ryan Clinton

Chinese AI Training Corpus Engine

zhorex/chinese-corpus-engine

Turn China's public web into AI-training-ready text. Pulls Weibo, Bilibili, Xueqiu, Douban & RedNote, then deduplicates, quality-scores, PII-scrubs and provenance-stamps every document. From $0.025/doc, pay-as-you-go. For LLM training-data teams, data vendors & academic NLP researchers.

Sami

Actor Fleet Operator: Fleet Ops & Analysis for Apify Developers

ryanclinton/actor-fleet-operator-mcp

Talk to your Apify fleet from Claude. Quality scoring, input and output validation, deploy gates, compliance triage, revenue rollups, decay forecasting, pricing simulation, duplicate detection. 25 tools across 6 groups. Decision-shaped JSON every automation branches on.

Ryan Clinton

Google Maps Email Extractor & Lead Scraper

highbrow_fame/google-maps-email-extractor

Google Maps email scraper with built-in MX/SPF/DMARC validation + catch-all detection. 50-70% email hit rate (vs 0-15% English-only). Multilingual crawl (10+ langs: kapcsolat/kontakt/contacto/contatti/...). Lead scoring 0-100, delta mode ($0 dupes). PAY_PER_EVENT: $0.005/lead.

yestrue

Google Maps Scraper

get-leads/google-maps-scraper---best-value-for-money

Extract business leads from Google Maps with verified emails, phones & social profiles. 50+ niches (HVAC, dentists, lawyers, real estate & more). DNS/SMTP email verification. $0.003/lead — up to 10x cheaper than alternatives. HubSpot/Salesforce export. MCP-ready for AI agents.

Japi Cricket

Weibo Scraper - Chinese Social Intelligence

zhorex/weibo-scraper

Extract Chinese public opinion, trending topics, brand sentiment, and creator data from Weibo (微博) — China's largest microblog with 580M+ users. Built for AI training corpora, Chinese equity research, and brand monitoring. No login, no browser. Part of the Chinese Digital Intelligence Suite.

Sami

162

1.0

(1)

OfferUp Scraper | US Marketplace Listings & Prices

haketa/offerup-scraper

OfferUp scraper & API (US classifieds): search listings by keyword and location and export title, price, condition, description, seller, location, photos, date and URL. US marketplace and resale market data plus seller lead generation — fast, no login.