All servers / Productivity / LLMBenchmark.ai
LLMBenchmark.ai
Which LLM for which task: benchmark scores and API prices for 400+ models. Free, no key.
Tested by ConnectATD Hosted serverTested 2026-11-22. Address: https://api.llmbenchmark.ai/mcp · Registry name: ai.llmbenchmark/llmbenchmark
Score 72 out of 100. Tested 2026-11-22.
Score breakdown
| Connects and stays up | 20 / 20 | |
|---|---|---|
| Tool descriptions | 12 / 20 | |
| Inputs explained | 0 / 15 | |
| Speed | 15 / 15 | |
| Safety basics | 10 / 15 | |
| Upkeep | 15 / 15 |
What we saw
- Connects and answers the MCP handshake: yes (1.1 seconds)
- Uses an encrypted (https) connection: yes
- Server reports itself as: LLMBenchmark.ai 1.0.0
- Tools offered: 6 · Parameters with a plain description: 0 of 13
- Official registry entry last updated: 2026-11-19
From the publisher
- No notes.
How hosted servers are graded
Hosted servers run on the publisher's own machines, so we cannot score downloads or install safety. We use six checks instead (connects and stays up 20, tool descriptions 20, inputs explained 15, speed 15, safety basics 15, upkeep 15). Speed is the first call to a safe, read-only tool (when a server marks none, the time to connect and list its tools), using a fresh request where we can so a saved answer cannot hide a slow one. We never call tools that write data or cost money. A server that needs a login or key is not graded. Full method.
Want this server set up for your team?
ConnectATD builds AI automation and wires up MCP servers like this one. Tell us what you are trying to do.
Talk to ConnectATDTools and how they are described
Agents choose tools from these descriptions.
recommend_model0 of 5 parameters describedWhich model should I use for this task? Maps the task text to a category (coding, agentic, reasoning, math, knowledge, web design, or overall when nothing matches) by a fixed keyword map, filters by output price per million tokens, context length and open weights, and ranks by that category's benchmark board. Deterministic, no LLM call. Returns top_k models with scores, rank, prices, context, page URLs and a one-line reason. overall is the LLMBenchmark Index: a weighted mean of the Vibe Coding Index, the agentic, reasoning, math and knowledge indexes, the Artificial Analysis Intelligence Index and the LMArena text Elo, with a 90% margin.
get_leaderboard0 of 2 parameters describedThe top models on one category's board. category is one of overall, coding, agentic, reasoning, math, knowledge, design (see list_categories). limit is 1 to 50. overall is the LLMBenchmark Index: a weighted mean of the Vibe Coding Index, the agentic, reasoning, math and knowledge indexes, the Artificial Analysis Intelligence Index and the LMArena text Elo, with a 90% margin.
compare_models0 of 2 parameters describedTwo models side by side: score on every category board where both were measured, prices, context. Names are matched loosely: 'claude opus', 'gpt-5' or a slug all work.
get_model0 of 1 parameter describedOne model: maker, release date, prices, context, open weights, and its score and rank on every category board. Name or slug.
get_prices0 of 3 parameters describedAPI prices (USD per million tokens), cheapest output price first: the maker's own price when it serves the model on OpenRouter, else the median of providers (price_basis says which), plus the cheapest provider. Filter by model name and/or maker; limit is 1 to 100.
list_categoriesno parametersThe categories recommend_model and get_leaderboard know, the benchmark board behind each, and the task keywords that select it.
Tested by ConnectATD. Spotted a mistake? Tell us.