Grade an AI agent deliverable against its spec

Created by

Novarithm

Actor

Escrow Evaluator: Agent Deliverable Verdict (ERC-8183)

Checks a deliverable (text, copy, code output) against the job specification, scores each requirement, and returns a pass or fail verdict with a signed attestation. Use it as an automatic evaluator for agent-to-agent jobs, escrow release, freelance QA or ERC-8004 style validation. Example: a product description that must mention waterproof and lightweight.

Try for free

Escrow Evaluator: Agent Deliverable Verdict (ERC-8183)calcio_you/escrow-evaluator

endpoint

input

result

+2 fields

Input

Jobs to evaluate

spec:Write a product description in English of at least 40 words. It must mention "waterproof" and "lightweight". Include a title.

deliverable:# TrailLite Jacket The TrailLite is a waterproof, lightweight shell built for hikers who move fast. It packs into its own pocket, weighs 280 g and keeps you dry in sudden storms. The price is $129 with free returns for 30 days, and it comes in four colours for men and women.

job_id:42

Output fields

endpoint

input

result

error

charged_event

How it works

Sign up on Apify or log in

The Escrow Evaluator: Agent Deliverable Verdict (ERC-8183) Actor is ready to run with the inputs already set for "Grade an AI agent deliverable against its spec". Sign up or log in and you'll land in Apify Console with a copy of this exact task.

Start the "Grade an AI agent deliverable against its spec" task

The Escrow Evaluator: Agent Deliverable Verdict (ERC-8183) Actor will start running based on the input automatically. You can also change all the input fields, like jobs to evaluate, to match your specific use case.

Receive the "Grade an AI agent deliverable against its spec" output

Monitor the progress in real time. You will be notified as soon as your dataset is complete and ready for review. Each result includes data such as endpoint, input, ok, and more.

Integrate into your workflow

The final output is delivered in JSON, CSV, or Excel format, ready to be plugged into your workflow. You can also run the "Grade an AI agent deliverable against its spec" task via API.