Llm Response Evaluator

Pricing

from $0.01 / 1,000 results

Llm Response Evaluator

Evaluate LLM outputs with comprehensive quality metrics and A/B testing capabilities. Free alternative to Confident AI ($99/mo).

Pricing

from $0.01 / 1,000 results

Rating

0.0

(0)

Developer

Cody Churchwell

Maintained by Community

Actor stats

Bookmarked

Total users

Monthly active users

19 days ago

Last modified

Operation

operationEnumOptional

Action to perform

Value options:

"evaluate": string"compare": string"abTest": string"generateReport": string

Default value of this property is "evaluate"

LLM Response

responseobjectOptional

Response to evaluate (JSON)

Evaluation Metrics

evaluationMetricsarrayOptional

Metrics to evaluate

Default value of this property is ["quality","relevance","toxicity","bias"]

Reference Response

referenceResponsestringOptional

Expected or ideal response for comparison

Responses to Compare

responsesToComparearrayOptional

Array of response objects to compare (JSON)

A/B Test Configuration

abTestConfigobjectOptional

A/B testing parameters (JSON)

Report Period

reportPeriodEnumOptional

Time range for evaluation report

Value options:

"today": string"week": string"month": string"all": string

Default value of this property is "week"

Filter by Model

filterByModelstringOptional

Filter evaluations by specific model

Quality Thresholds

thresholdsobjectOptional

Minimum acceptable scores (JSON)

Metric Weightings

weightingsobjectOptional

Relative importance of each metric (JSON)

Website Content to Markdown for LLM Training

easyapi/website-content-to-markdown-for-llm-training

🚀 Transform web content into clean, LLM-ready Markdown! 📘 Scrape multiple pages, extract main content, and convert to Markdown format. Perfect for AI researchers, data scientists, and LLM developers. Fast, efficient, and customizable. Supercharge your AI training data today! 🌐📝🧠

EasyApi

216

5.0

Ai Prompt Library

fiery_dream/ai-prompt-library

Production-grade prompt version control and A/B testing. Track performance, compare versions, rollback changes. Free alternative to PromptLayer ($49-299/mo).

Cody Churchwell

B2b Company Scraper [apollo alternative]

olympus/b2b-company-scraper-rental

Scrape company data from your favorite b2b platform

Olympus

125

5.0

Testing actor

flow_matic/testing-actor

Flow Matic

🔥 AI HTML to JSON Extractor (Fast, Free LLM for Data)

autoscaler/ai-html-to-json-extractor

Eliminate messy HTML cleanup and high LLM costs. This Actor uses a high-speed, zero-cost large language model to turn unstructured content (HTML, text, reviews, blog posts) into valid, structured JSON.

Mooo

🟢 B2b Leads Finder - $1/1k leads [alternative to apollo]

olympus/b2b-leads-finder

🚨 UPDATE: ✅ Work & Personal Emails ✅ 📞 Phone numbers | Extract premium leads from your favorite b2b platforms with just a search URL

Olympus

1.2K

3.1

Extract-any-webpage-content-for-llm

ai-developer/extract-any-webpage-content-for-llm

Fast and easy way to extract data from any webpage and are LLM friendly. The tool lets you easily extract content from any website. Ideal for researchers, marketers, and developers.

aideveloper

577

LLM Dataset Processor

dusan.vystrcil/llm-dataset-processor

Allows you to process output of other actors or stored dataset with single LLM prompt. It's useful if you need to enrich data, summarize content, extract specific information, or manipulate data in a structured way using AI.