Duplicate Content Similarity Finder

Store Positioning

Store title: Duplicate Content Similarity Finder

Short description: Compare pages for duplicate and near-duplicate main content using normalized shingles and canonical signals.

SEO title: Duplicate Content Similarity Finder — technical SEO, web, and domain audit

SEO description: Compare pages for duplicate and near-duplicate main content using normalized shingles and canonical signals. Use it to find crawlability, indexability, security, metadata, and page-quality issues with evidence-backed rows and audit reports.

Categories: SEO_TOOLS

Keywords: duplicate, content, similarity, finder, web/domain audit

Fixed-Inclusive PPE Pricing

This actor uses pay-per-event pricing. Event prices include Apify platform usage; users are not expected to pay a separate platform-usage pass-through charge for the configured pricing model.

• Tier: W1 — Web/domain audit
• Primary event: page-audited at $0.00490 base
• Default max charge: $10.00
• Store discounts: FREE/BRONZE base, SILVER discounted, GOLD deepest approved discount

Event set:

• actor-start: base $0.00500, GOLD $0.00400. Duplicate Content Similarity Finder: charged when actor start is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
• page-audited: base $0.00490, GOLD $0.00392. Duplicate Content Similarity Finder: charged when page audited is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
• record-extracted: base $0.00372, GOLD $0.00298. Duplicate Content Similarity Finder: charged when record extracted is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
• finding-emitted: base $0.00372, GOLD $0.00298. Duplicate Content Similarity Finder: charged when finding emitted is completed. The price includes Apify platform usage; no separate usage pass-through is intended.
• audit-report-generated: base $0.05000, GOLD $0.04000. Duplicate Content Similarity Finder: charged when audit report generated is completed. The price includes Apify platform usage; no separate usage pass-through is intended.

Public Task Concepts

• Audit Duplicate Content Similarity controls on a capped public sample
• Find high-priority Duplicate Content Similarity issues before release
• Validate Duplicate Content Similarity evidence from supplied pages
• Prioritize Duplicate Content Similarity fixes with severity and proof
• Export Duplicate Content Similarity QA rows for client review

Compare pages for duplicate and near-duplicate main content using normalized shingles and canonical signals.

This actor supports real URL fetching, sitemap discovery, and offline supplied HTML/text paths where advertised by the locked spec. It writes dataset rows and key-value store report artifacts.

Inputs

• startUrls
• sitemapUrls
• htmlInputs
• textRecords
• allowedDomains
• maxPages
• maxPairs
• similarityThreshold
• nearDuplicateThreshold
• contentSelectors
• excludeSelectors
• includeEvidenceSnippets
• timeoutMs

Dataset fields

• sourceUrlA
• sourceUrlB
• titleA
• titleB
• canonicalA
• canonicalB
• wordCountA
• wordCountB
• similarityScore
• sharedFingerprintCount
• duplicateGroupId
• comparisonType
• canonicalConflict
• evidenceSnippetA
• evidenceSnippetB
• issueCode
• severity
• recommendation

Local validation

Run npm test for exact-value analyzer tests and npm run check for JavaScript syntax validation.

Billing and cost controls

This actor uses fixed-inclusive pay-per-event pricing. It charges actor-start, then page-audited before each dataset row, and audit-report-generated before report artifacts. maxChargeUsd is enforced locally and in Apify runs; uncharged rows and reports are withheld. Platform usage pass-through remains off.