RAG Content Quality Auditor
Pricing
from $3.00 / 1,000 page auditeds
Audit websites or Apify datasets before RAG/LLM ingestion. Score content quality, detect duplicates and low-value pages, estimate tokens, and identify what to keep for AI knowledge bases, embeddings, and vector databases.
Audit accessible website pages or content already stored in an Apify dataset.
Public HTTP(S) starting page. Only this hostname is visited. Ignored in dataset mode.
Maximum page attempts or source dataset rows, including failures and skipped content.
Required for Existing dataset mode. Select a dataset that this Actor may read. The selected dataset ID or unique name is passed to the Actor.
Start page is depth 0. Sitemap pages are depth 1. Set 0 to audit only the starting page.
Optional full-URL globs. The suggested first run stays in the Python tutorial. Replace this pattern for another section, or clear the list to include all eligible same-host URLs.
[]Full-URL globs to skip. Exclusions take precedence, including for redirects.
[]Check observed crawl rules before fetching pages. Unavailable rules are reported; server/network errors cause conservative skipping.
Compare extracted main content within this run before scoring pages.
Observe /llms.txt and /llms-full.txt once. Their absence does not affect scores. Website mode only.
Maximum simultaneous page fetches. Lower values reduce load on the source website.