LM Bench avatar
LM Bench
Under maintenance

Pricing

Pay per usage

Go to Apify Store
LM Bench

LM Bench

Under maintenance

A daily-updated intelligence feed that merges LLM quality (LMArena ELO) and LLM pricing (OpenRouter) into one clean, normalized dataset — so you can always choose the best model for your task with best price daily.

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Yue Yang

Yue Yang

Maintained by Community

Actor stats

0

Bookmarked

2

Total users

1

Monthly active users

a day ago

Last modified

Share

🚀 Daily LLM Intelligence

A daily-updated intelligence feed that merges LLM quality (LMArena ELO) and LLM pricing (OpenRouter) into one clean, normalized dataset — so you can always choose the best model for your task.


❓ What’s the problem?

Every AI app says:

“We use the best model for your task.”

But in reality, most apps are NOT using the best model:

  • Many pay 10× more for a model that’s not actually better.
  • Many use outdated choices because pricing and performance change every week.
  • Everyone thinks they know which LLM is best — but no one actually tracks it daily.

So companies waste money, use wrong models, and miss cheaper or better options.


🧩 What do we have today?

We already have:

  • Quality data from LMArena (ELO scores)
    → but it’s not connected to pricing.

  • Pricing data from OpenRouter
    → but the model names don’t match.

  • Many model variants & providers
    → but no unified naming.

So although the data exists, it is fragmented and unusable for real decisions.


✅ What did I build?

I built Daily LLM Intelligence — an Apify Actor that:

  • ✔ Tracks LLM quality daily (from LMArena)
  • ✔ Tracks LLM pricing daily (from OpenRouter)
  • Normalizes model names (fixes the Qwen / Qwen2.5 / 72B chaos)
  • ✔ Merges everything into one clean dataset

Each row = one canonical model with:

  • Quality score (ELO)
  • Price (input / output)
  • Provider
  • License
  • Rank by quality
  • Rank by price
  • Value ratio

🧠 What can users do with it?

With this dataset, you can:

  • Automatically pick the best-value LLM
  • Avoid overspending
  • Route traffic to cheapest high-quality models
  • Build dashboards or alerts
  • Build an auto model router
  • Pair it with a recommendation agent

It turns LLM selection into a data-driven decision, not guesswork.


⚙️ How does it work?

  1. Fetch LMArena leaderboard
  2. Fetch OpenRouter pricing
  3. Normalize model names
  4. Merge into one clean table
  5. Compute basic ranks
  6. Output daily dataset

Fully automated.


🧱 What’s inside the Actor?

  • LMArena scraper
  • OpenRouter pricing fetcher
  • Model name normalizer
  • Merge engine
  • Rank calculator
  • Dataset writer

Minimal. Stable. Production-oriented.


⚡ 10-second Version

Most AI apps use the wrong model and waste money.
Quality and pricing change constantly, but no one tracks them daily.

Daily LLM Intelligence merges real quality + real price + name normalization into one clean dataset — so you can always pick the best model today.