LLM Latency & Cost Monitor

LLM Provider Price and Latency Monitor

george.the.developer/llm-provider-price-latency-monitor

Normalize model pricing, context length, capabilities, and provider routing data for LLM gateways, AI builders, and FinOps teams.

A simple tool concept for checking website response time and basic latency signals before choosing a VPS location.

Multi-Model LLM Compare - GPT, Claude, Gemini & Llama

seemuapps/multi-model-llm-compare

Run one prompt across many language models at once and get every response side by side, with token counts, cost, and latency per model in a single dataset.

AI llm.txt File Generator API

dev00/ai-llm-txt-file-generator-api

Generate llm.txt files automatically for any website. Map website directories and convert documentation into clean markdown structured llm.txt files for LLM agents.

Query OpenRouter for LLM models, pricing, and routing. List available models with capabilities and cost, find the cheapest model for your task, or route prompts to specific models.

LLM API Pricing Monitor & Tracker

devilscrapes/llm-pricing-monitor

Scrape and compare live LLM API pricing from OpenAI, Anthropic, Google, Mistral, Groq, Together AI, and DeepSeek — normalized per-million-token, export to JSON or CSV. A continuously updated LLM API pricing comparison table for cost dashboards and FinOps.

Pay-per-event LLM cost analysis. POST a JSONL log or array of LLM call entries; get back per-day/per-model spend, top costly calls, and rule-based route recommendations. Local-first alternative: tokenmark npm package.

Llm Benchmarks

david_flagg/llm-benchmarks

Unified LLM data — pricing, benchmarks, specs, and local deployment info for 300+ models. Compare cost, Open LLM Leaderboard scores, Arena ratings, context lengths, GGUF availability, and VRAM estimates in one dataset.

Measure website response times, Time-to-First-Byte, and status codes across thousands of URLs for uptime monitoring and performance audits.

🔥 AI HTML to JSON Extractor (Fast, Free LLM for Data)

autoscaler/ai-html-to-json-extractor

Eliminate messy HTML cleanup and high LLM costs. This Actor uses a high-speed, zero-cost large language model to turn unstructured content (HTML, text, reviews, blog posts) into valid, structured JSON.