Chatbot Arena ELO
Chatbot Arena is a crowdsourced benchmark platform where users have blind conversations with two anonymous AI models and vote for the better response. The resulting ELO ratings provide a human-preference-based ranking that captures real-world conversational quality. With over 1 million votes collected, it is widely considered the most representative benchmark of actual user satisfaction and practical model utility.
Metrics
ELO rating based on human preference votes
Created By
LMSYS Org (UC Berkeley)
Paper
View paper →Website
Visit website →Top Model Scores
| Rank | Model | Score | Date |
|---|---|---|---|
| 1 | GPT-5.2 | 1385 | 2026-03 |
| 2 | Claude Opus 4.6 | 1372 | 2026-02 |
| 3 | Gemini 3 Ultra | 1358 | 2026-01 |
| 4 | Grok 4 | 1341 | 2026-02 |
| 5 | DeepSeek-V4 | 1329 | 2026-01 |
Related General Benchmarks
Chatbot Arena (LMSYS)
Chatbot Arena is a crowdsourced evaluation platform where users engage in blind, head-to-head comparisons of AI chatbots. Models are ranked using an Elo rating system based on hundreds of thousands of human preference votes.
Top: GPT-5.2 — 1387
LiveBench
LiveBench is a continuously updated benchmark designed to minimize contamination by using new questions monthly. It covers math, coding, reasoning, language, instruction following, and data analysis with objective, verifiable answers.
Top: GPT-5.2 — 82.6%
Arena-Hard-Auto
Arena-Hard-Auto is an automated benchmark that correlates highly with Chatbot Arena rankings. It uses 500 challenging user queries and automated judge evaluation to approximate human preferences at a fraction of the cost.
Top: GPT-5.2 — 92.1%
TAU-bench
TAU-bench evaluates AI agents on real-world tasks requiring tool use and multi-step reasoning in retail and airline customer service domains. It measures end-to-end task completion with realistic tool APIs.
Top: Claude Opus 4.6 — 68.4%