Audit RAG chunks before Pinecone

Created by

Sebastián S

Actor

RAG Dataset Linter

Validate RAG chunk structure, provenance, duplicate content, and overlap before uploading embeddings to a Pinecone index.

Try for free

RAG Dataset Lintersebastian-actors/rag-dataset-linter

Gate

Action

Source type

Source ID

+9 fields

Input

Minimum tokens:10

Maximum tokens:2000

Near-duplicate similarity:0.95

Maximum adjacent overlap ratio:0.35

Inline records

chunkId:pinecone-guide-0+2

documentId:pinecone-guide+2

sourceUrl:https://example.com/pinecone-guide+2

chunkIndex:0+2

title:Pinecone ingestion guide+2

headingPath

chunkText:Validate chunk identifiers, document provenance, source URLs, and retrieval context before uploading vectors to Pinecone. A pre-ingestion quality gate prevents malformed records from entering the production index.+2

Maximum chunks:1000

Output fields

Gate

Action

Source type

Source ID

Audited

Findings

Errors

Warnings

Exact duplicate rate

Near duplicate rate

Estimated wasted tokens

Truncated

Finished

How it works

Sign up on Apify or log in

The RAG Dataset Linter Actor is ready to run with the inputs already set for "Audit RAG chunks before Pinecone". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Audit RAG chunks before Pinecone" task

The RAG Dataset Linter Actor will start running based on the input automatically. You can also change all the input fields, like minimum tokens, maximum tokens, and more, to match your specific use case.

Receive the "Audit RAG chunks before Pinecone" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as gate, action, source type, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Audit RAG chunks before Pinecone" task via API.