Go to example tasks
Find Duplicate and Stale RAG Documents
Created by
Michael Olmos
Audit a realistic help-center RAG sample to catch stale content and exact duplicates before indexing.
RAG Dataset Quality Auditorgifted_wagon/rag-dataset-quality-auditor
Quality score
Grade
Document ID
Title
+9 fieldsTextNumberBooleanListObject
Input
Inline documents
Document ID:help-center-101+1
Source URL:https://example.com/help/reset-password+1
Document title:Reset a customer password+1
Document text:Customers can reset a forgotten password from the sign-in screen. Select Forgot password, enter the verified account email, and submit the request. The service sends a single-use reset link that expires after thirty minutes. Open the link, choose a new password that meets the displayed security requirements, and confirm the change. Existing sessions are signed out after the reset completes. If the message does not arrive, check the spam folder, confirm the address, and wait two minutes before requesting another link. Support agents should never ask customers to share passwords or reset links.+1
Updated at:2026-08-01T00:00:00.000Z+1
Minimum useful words:60
Stale after days:365
Near-duplicate similarity:0.92
Include content preview:false
Output fields
Quality score
Grade
Document ID
Title
Source URL
Words
Issues
Critical
High
Exact duplicate of
Near duplicate of
Similarity
Issue codes
Sign up on Apify01
Create your Apify account to access the RAG Dataset Quality Auditor.
Start the run02
The Actor will start running based on the input automatically.
Receive the output03
Monitor the progress in real-time. You will be notified as soon as your dataset is complete and ready for review.
Integrate into your workflow04
The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow.
