Systra Ai Rag Evaluation Dataset Generator Task

Created by

Troy Hendrick

Actor

Rag Evaluation Dataset Generator

The Systra AI RAG Evaluation Dataset Generator creates in-depth, citation-grounded evaluation datasets from specified sources. This task generates 80 test cases, including factual, procedural, and unanswerable questions, complete with reference answers and evidence quotes. Ideal for validating RAG models with credible data, it exports in JSONL, CSV, or RAGAS formats.

Try for free

Rag Evaluation Dataset Generatorsystra_ai/systra-ai-rag-evaluation-dataset-generator

Question

Expected answer

Answerability

Question type

+3 fields

Input

Source URLs:https://rafflex.io/

Inline documents

Crawl mode:sitemap

JavaScript rendering:auto

Maximum pages:50

Maximum crawl depth:3

Target evaluation cases:80

Question types:factual+4

Question language:English

OpenAI model:gpt-5.6-luna

Maximum chunk characters:5000

Chunk overlap characters:400

Cases per model call:6

Maximum bytes per source:10000000

Output fields

Question

Expected answer

Answerability

Question type

Difficulty

Source references

Grading guidance

How it works

Sign up on Apify or log in

The Rag Evaluation Dataset Generator Actor is ready to run with the inputs already set for "Systra Ai Rag Evaluation Dataset Generator Task". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Systra Ai Rag Evaluation Dataset Generator Task" task

The Rag Evaluation Dataset Generator Actor will start running based on the input automatically. You can also change all the input fields, like source urls, inline documents, and more, to match your specific use case.

Receive the "Systra Ai Rag Evaluation Dataset Generator Task" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as question, expected answer, answerability, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Systra Ai Rag Evaluation Dataset Generator Task" task via API.