Chatbot Arena +

This leaderboard is based on the following benchmarks.

Arena + — an agent-driven battle platform for large language models (LLMs). We use LLM-as-a-judge to compute Elo ratings.
AAII — Artificial Analysis Intelligence Index aggregating 10 challenging evaluations.
ARC-AGI — Artificial General Intelligence benchmark v2 to measure fluid intelligence.

🔍

Open LM

	Model	Arena Elo	Coding	Vision	AAII	MMLU-Pro	ARC-AGI	Organization	License
🏆	Claude Opus 5	`1511`	`1566`	`1314`	`63`	`91.6`	`90.4`	Anthropic	Proprietary
🏆	Claude Fable 5	`1510`	`1566`	`1312`	`62`	`91.5`	`89.2`	Anthropic	Proprietary
🏆	GPT-5.6 Sol	`1509`	`1567`	`1312`	`61`	`90.2`	`92.5`	OpenAI	Proprietary
🥇	Grok-4.6	`1507`	`1563`	`1310`	`61`	`89.6`	`75`	xAI	Proprietary
🥇	Kimi-K3 ✅	`1506`	`1562`	`1311`	`60`	`89.3`		Moonshot	Kimi K3
🥇	Claude Opus 4.8 Thinking	`1506`	`1562`	`1310`	`58`	`90.1`	`78`	Anthropic	Proprietary
🥇	Qwen3.8-Max ✅	`1506`	`1560`	`1312`	`58`	`89.8`		Alibaba	Qwen3
🥇	GPT-5.6 Terra	`1505`	`1562`	`1310`	`57`	`89.6`	`83.9`	OpenAI	Proprietary
🥇	GPT-5.5-high	`1505`	`1561`	`1311`	`57`	`89.6`	`85`	OpenAI	Proprietary
🥇	GLM-5.3 ✅	`1505`	`1560`		`59`	`87.8`		Z.ai	MIT
🥇	Claude Opus 4.7 Thinking	`1504`	`1559`	`1309`	`56`	`90`	`75.8`	Anthropic	Proprietary
🥇	Grok-4.5	`1504`	`1556`	`1305`	`56`	`89.5`		xAI	Proprietary
🥇	Gemini-3.1-Pro	`1504`	`1531`	`1309`	`56`	`91`	`77.1`	Google	Proprietary
🥇	Claude Opus 4.8	`1503`	`1558`	`1306`	`55`	`90`	`62.2`	Anthropic	Proprietary
🥇	Gemini-3.7-Flash	`1503`	`1557`	`1303`	`56`	`90`	`80.6`	Google	Proprietary
🥇	Claude Opus 4.7	`1502`	`1554`	`1300`	`54`	`89.9`	`62.1`	Anthropic	Proprietary
🥇	DeepSeek-V4-Pro	`1502`	`1550`		`54`	`87.5`		DeepSeek	MIT
🥇	Claude Opus 4.6 Thinking	`1502`	`1545`	`1304`	`54`	`89.7`	`69.2`	Anthropic	Proprietary
🥇	Muse Spark 1.2	`1502`	`1540`	`1300`	`56`	`88.8`		Meta	Proprietary
🥈	Gemini-3.6-Flash	`1501`	`1535`	`1301`	`54`	`90`	`72.1`	Google	Proprietary
🥈	GPT-5.4-high	`1496`	`1538`	`1290`	`54`	`88.6`	`74`	OpenAI	Proprietary
🥈	Muse Spark 1.1	`1496`	`1521`	`1298`	`54`	`88.7`		Meta	Proprietary
🥈	Grok-4.20	`1495`	`1518`	`1279`	`53`	`88.6`	`65.1`	xAI	Proprietary
🥈	Gemini-3-Pro	`1492`	`1501`	`1308`	`54`	`90`	`33.6`	Google	Proprietary
🥈	Claude Opus 4.6	`1490`	`1535`	`1298`	`52`	`89.5`	`64.6`	Anthropic	Proprietary
🥈	GLM-5.2	`1488`	`1525`		`54`	`87.5`	`22.8`	Z.ai	MIT
🥈	Qwen3.7-Max	`1486`	`1505`	`1289`	`53`	`89.6`		Alibaba	Proprietary
🥈	Claude Sonnet 5 Thinking	`1485`	`1520`	`1285`	`54`	`89`		Anthropic	Proprietary
🥈	Muse Spark	`1484`	`1493`	`1294`	`52`	`87.3`		Meta	Proprietary
🥈	Grok-4.1-Thinking	`1482`	`1483`		`51`	`88.2`	`26`	xAI	Proprietary
🥈	ERNIE-5.1	`1475`	`1495`		`52`	`87.1`		Baidu	Proprietary
🥈	Claude Opus 4.5 (thinking-32k)	`1469`	`1510`		`51`	`89.5`	`30.6`	Anthropic	Proprietary
🥈	Claude Sonnet 4.6 Thinking	`1468`	`1511`	`1278`	`52`	`88`	`60.4`	Anthropic	Proprietary
🥈	GLM-5.1	`1467`	`1506`		`52`	`87.1`	`5.1`	Z.ai	MIT
🥈	Seed2.0 Pro	`1466`	`1495`	`1288`	`51`	`87.8`		ByteDance	Proprietary
🥈	Kimi-K2.6-Thinking	`1466`	`1493`	`1286`	`52`	`87.3`		Moonshot	Modified MIT
🥈	Qwen3.5-Max	`1466`	`1493`		`51`	`87.8`		Alibaba	Proprietary
🥈	MiMo-V2.5-Pro	`1466`	`1485`		`51`	`87`		Xiaomi	MIT
🥈	GPT-5.2-high	`1465`	`1470`	`1280`	`53`	`87.5`	`52.9`	OpenAI	Proprietary
🥈	Gemini-3-Flash	`1465`	`1469`	`1292`	`52`	`89`	`31.1`	Google	Proprietary
🥈	GPT-5.4	`1465`	`1468`	`1275`	`51`	`88.4`	`29.2`	OpenAI	Proprietary
🥈	GPT-5.1-high	`1464`	`1466`	`1250`	`51`	`87.1`	`17.6`	OpenAI	Proprietary
🥈	GPT-5.2	`1464`	`1465`	`1248`	`49`	`87.4`	`26.7`	OpenAI	Proprietary
🥈	Grok-4.1	`1463`	`1463`		`49`	`88`		xAI	Proprietary
🥈	Claude Opus 4.5	`1462`	`1496`		`40`	`88.8`	`7.8`	Anthropic	Proprietary
🥈	GPT-5.4-mini-high	`1461`	`1461`		`49`	`87`	`18.9`	OpenAI	Proprietary
🥈	Claude Sonnet 4.6	`1460`	`1500`	`1277`	`45`	`87.3`	`37.6`	Anthropic	Proprietary
🥉	Gemini-2.5-Pro	`1459`	`1465`	`1266`	`43`	`86.2`	`4.9`	Google	Proprietary
🥉	ERNIE-5.0	`1458`	`1461`	`1251`	`45`	`86`		Baidu	Proprietary
🥉	Qwen3.6-Plus	`1456`	`1482`		`51`	`88.5`		Alibaba	Proprietary
🥉	Minimax-M3	`1452`	`1485`		`51`	`87.2`		MiniMax	Non-commercial
🥉	GLM-5	`1452`	`1461`		`51`	`87`	`5`	Z.ai	MIT
🥉	Kimi-K2.5-Thinking	`1451`	`1480`	`1271`	`50`	`87.1`	`11.8`	Moonshot	Modified MIT
🥉	DeepSeek-V4-Flash	`1451`	`1466`		`51`	`86.2`	`61.4`	DeepSeek	MIT
🥉	GPT-5.6 Luna	`1451`	`1465`		`51`	`86.1`	`59.5`	OpenAI	Proprietary
🥉	Qwen3.8-27B	`1450`	`1465`		`51`	`86.3`		Alibaba	Apache 2.0
🥉	Qwen3.5-397B-A17B	`1450`	`1463`		`50`	`87.8`	`5`	Alibaba	Apache 2.0
🥉	Gemma-4-31B-it	`1449`	`1462`		`43`	`85.2`		Google	Apache 2.0
🥉	GLM-4.7	`1445`	`1460`		`49`	`85.6`		Z.ai	MIT
🥉	GPT-5-high	`1444`	`1460`	`1232`	`46`	`87.1`	`9.9`	OpenAI	Proprietary
🥉	Qwen3-Max	`1443`	`1468`		`44`	`85.3`		Alibaba	Proprietary
🥉	Gemma-4-26B-A4B-it	`1443`	`1460`		`36`	`82.6`		Google	Apache 2.0
🥉	Grok-4	`1442`	`1453`	`1221`	`46`	`86.6`	`16`	xAI	Proprietary
🥉	GLM-4.6	`1441`	`1458`		`36`	`83.5`		Z.ai	MIT
🥉	GPT-5.1	`1440`	`1450`	`1243`	`46`	`87`	`7.5`	OpenAI	Proprietary
🥉	Kimi-K2-Thinking	`1438`	`1450`		`48`	`84.8`		Moonshot	Modified MIT
🥉	Claude Sonnet 4.5 (thinking-32k)	`1432`	`1485`		`41`	`87.5`	`13.6`	Anthropic	Proprietary
🥉	MiMo-V2-Pro	`1431`	`1441`		`50`	`86.8`		Xiaomi	Proprietary
🥉	GLM-4.5	`1430`	`1448`		`34`	`83.5`		Z.ai	MIT
🥉	Qwen3-VL-235B-A22B-Instruct	`1429`	`1457`	`1246`	`29`	`82.8`		Alibaba	Apache 2.0
🥉	Mistral Large 3	`1428`	`1450`		`21`	`81`		Mistral	Apache 2.0
🥉	ChatGPT-4o-latest (2025-03-26)	`1427`	`1434`	`1242`	`20`	`80.3`		OpenAI	Proprietary
🥉	DeepSeek-R1-0528	`1426`	`1436`		`37`	`84.9`	`1.3`	DeepSeek	MIT
🥉	Claude Opus 4.1 (thinking-16k)	`1425`	`1475`		`39`	`87.8`		Anthropic	Proprietary
🥉	o3-2025-04-16	`1424`	`1441`	`1218`	`45`	`85.3`	`6.5`	OpenAI	Proprietary
🥉	Grok-3-Preview-02-24	`1423`	`1439`		`24`	`79.9`		xAI	Proprietary
🥉	Hunyuan-Hy3	`1422`	`1448`		`46`	`86.2`		Tencent	Tencent
🥉	DeepSeek-V3.2-Thinking	`1422`	`1438`		`46`	`86.2`	`4`	DeepSeek	MIT
🪙	Gemini-3.1-Flash-Lite	`1421`	`1402`	`1230`	`40`	`86.2`		Google	Proprietary
🪙	Claude Sonnet 4.5	`1420`	`1464`		`29`	`86`		Anthropic	Proprietary
🪙	LongCat-Flash-Chat	`1420`	`1461`		`29`	`82.7`		Meituan	MIT
🪙	Claude Opus 4.1	`1419`	`1465`		`27`	`87.3`		Anthropic	Proprietary
🪙	Grok-4-Fast	`1419`	`1441`		`42`	`85`		xAI	Proprietary
🪙	Qwen3-235B-A22B-Instruct-2507	`1418`	`1457`		`29`	`82.8`	`1.3`	Alibaba	Apache 2.0
🪙	Nemotron-3-Ultra-550B-A55B	`1418`	`1452`		`51`	`86.8`		Nvidia	Nvidia Open
🪙	DeepSeek-V3.1-Thinking	`1418`	`1437`		`38`	`85.1`		DeepSeek	MIT
🪙	DeepSeek-V3.2	`1418`	`1431`		`32`	`83.7`		DeepSeek	MIT
🪙	Qwen3-Next-80B-A3B-Instruct	`1417`	`1456`		`37`	`82.4`		Alibaba	Apache 2.0
🪙	Amazon-Nova-Chat-11-10	`1417`	`1431`		`42`	`83`		Amazon	Proprietary
🪙	DeepSeek-V3.1	`1417`	`1430`		`27`	`83.3`		DeepSeek	MIT
🪙	Minimax-M2.7	`1416`	`1448`		`50`	`87.1`		MiniMax	Non-commercial
🪙	Qwen3-235B-A22B-Thinking-2507	`1416`	`1442`		`42`	`84.3`		Alibaba	Apache 2.0
🪙	GPT-4.5-Preview	`1415`	`1419`	`1190`	`21`	`81`	`0.8`	OpenAI	Proprietary
🪙	GPT-5-chat	`1413`	`1421`	`1238`	`45`	`86.6`	`7.5`	OpenAI	Proprietary
🪙	Gemini-2.5-Flash	`1412`	`1420`	`1235`	`36`	`83.2`	`2.5`	Google	Proprietary
🪙	Qwen3-VL-235B-A22B-Thinking	`1411`	`1432`	`1215`	`42`	`84.3`		Alibaba	Apache 2.0
🪙	Hunyuan-Vision-1.5-Thinking	`1410`	`1419`	`1220`		`86.2`		Tencent	Proprietary
🪙	Minimax-M2.5	`1408`	`1436`		`45`	`87`	`4.9`	MiniMax	Modified MIT
🪙	MiMo-V2-Flash	`1402`	`1411`		`41`	`84.8`		Xiaomi	MIT
🪙	Mistral Medium 3.1	`1401`	`1412`		`20`	`77.2`		Mistral	Proprietary
🪙	Hunyuan-T1-20250711	`1400`	`1409`			`86.2`		Tencent	Proprietary
🪙	Minimax-M2.1	`1399`	`1430`		`44`	`87`		MiniMax	Modified MIT
🪙	MAI-1-Preview	`1398`	`1406`					Microsoft	Proprietary
🪙	Gemini-2.0-Pro-Exp-02-05	`1398`	`1396`	`1170`	`19`	`80.5`		Google	Proprietary
🪙	Gemini-2.0-Flash-Thinking-Exp-01-21	`1397`	`1383`	`1208`	`21`	`79.8`		Google	Proprietary
🪙	Step-3.5-Flash	`1387`	`1433`		`40`	`83.5`		StepFun	Apache 2.0
🪙	GLM-4.5-Air	`1386`	`1410`		`27`	`81.5`		Z.ai	MIT
🪙	Qwen3-30B-A3B-Instruct-2507	`1382`	`1425`		`24`	`77.7`		Alibaba	Apache 2.0
🪙	Kimi-K2-0905-Preview	`1382`	`1403`		`29`	`82.4`		Moonshot	Modified MIT
🪙	Qwen-VL-Max-2025-08-13	`1381`	`1440`	`1213`				Alibaba	Proprietary
🪙	GPT-4.1-2025-04-14	`1381`	`1396`	`1207`	`25`	`80.6`	`0.4`	OpenAI	Proprietary
🪙	Kimi-K2-0711-Preview	`1380`	`1402`		`27`	`82.4`		Moonshot	Modified MIT
🪙	Claude Haiku 4.5	`1378`	`1436`		`22`	`80`		Anthropic	Proprietary
🪙	DeepSeek-V3-0324	`1377`	`1391`		`22`	`81.9`		DeepSeek	MIT
🪙	Hunyuan-Turbos-20250416	`1377`	`1390`			`78`		Tencent	Proprietary
🪙	Claude Opus 4 (thinking-16k)	`1376`	`1434`	`1188`	`37`	`87.3`	`8.6`	Anthropic	Proprietary
🪙	GPT-5-mini	`1375`	`1419`	`1214`	`42`	`82.8`	`4.4`	OpenAI	Proprietary
🪙	DeepSeek-R1	`1373`	`1382`		`28`	`84.4`	`1.3`	DeepSeek	MIT
🪙	Gemini-2.0-Flash-Exp	`1370`	`1371`	`1191`	`19`	`78.2`	`1.3`	Google	Proprietary
🪙	Qwen3-235B-A22B	`1369`	`1394`		`26`	`82.8`		Alibaba	Apache 2.0
🪙	Mistral Medium 3	`1369`	`1387`	`1159`	`19`	`76`		Mistral	Proprietary
🪙	gpt-oss-120b	`1368`	`1398`		`39`	`80.8`		OpenAI	Apache 2.0
🪙	Qwen2.5-Max	`1367`	`1373`		`17`	`76.2`		Alibaba	Proprietary
🪙	Claude Opus 4	`1366`	`1405`	`1173`	`25`	`86`	`1.3`	Anthropic	Proprietary
🪙	Grok-3-mini-high	`1366`	`1380`		`36`	`82.8`		xAI	Proprietary
🪙	o1-2024-12-17	`1366`	`1378`	`1166`	`30`	`84.1`	`1.3`	OpenAI	Proprietary
🪙	o4-mini-2025-04-16	`1362`	`1385`	`1192`	`43`	`83.2`	`6.1`	OpenAI	Proprietary
🪙	Step-3	`1360`	`1400`	`1190`				StepFun	Proprietary
🪙	Qwen3-Coder-480B-A35B-Instruct	`1358`	`1406`		`23`	`78.8`		Alibaba	Apache 2.0
🪙	Nemotron-3-Super-120B-A12B	`1357`	`1401`		`40`	`83.7`		Nvidia	Nvidia Open
🪙	Gemma-3-27B-it	`1356`	`1350`	`1163`	`11`	`66.9`		Google	Gemma
🪙	INTELLECT-3	`1355`	`1376`					Prime Intellect	MIT
🪙	Claude Sonnet 4 (thinking-32k)	`1351`	`1412`	`1187`	`37`	`84.2`	`5.9`	Anthropic	Proprietary
🪙	Minimax-M1	`1351`	`1369`		`31`	`81.6`		MiniMax	Apache 2.0
🪙	Qwen3-32B	`1342`	`1376`		`22`	`79.8`		Alibaba	Apache 2.0
🪙	Llama-3.3-Nemotron-Super-49B-v1.5	`1340`	`1359`		`30`	`81.4`		Nvidia	Nvidia Open
🪙	Step-1o-Turbo-202506	`1339`	`1361`	`1182`				StepFun	Proprietary
🪙	o3-mini-high	`1338`	`1380`		`33`	`80.2`	`3`	OpenAI	Proprietary
🪙	GPT-4.1-mini-2025-04-14	`1338`	`1370`	`1177`	`21`	`78.1`		OpenAI	Proprietary
🪙	Gemini-2.5-Flash-Lite	`1337`	`1362`	`1205`	`22`	`75.9`		Google	Proprietary
🪙	Mistral-Small-3.2-2506	`1337`	`1361`	`1145`	`15`	`68.1`		Mistral	Apache 2.0
🪙	Claude Sonnet 4	`1335`	`1384`	`1170`	`24`	`83.7`	`1.3`	Anthropic	Proprietary
🪙	Gemma-3-12B-it	`1335`	`1310`		`11`	`59.5`		Google	Gemma
🪙	DeepSeek-V3	`1334`	`1337`		`17`	`75.2`		DeepSeek	DeepSeek
🪙	GPT-5-nano	`1333`	`1363`	`1166`	`32`	`77.2`	`2.6`	OpenAI	Proprietary
🪙	QwQ-32B	`1332`	`1351`		`26`	`76.4`		Alibaba	Apache 2.0
🪙	GLM-4-Plus-0111	`1332`	`1310`			`78.6`		Z.ai	Proprietary
🪙	Gemini-2.0-Flash-Lite	`1330`	`1338`	`1097`	`14`	`72.4`		Google	Proprietary
🪙	Qwen-Plus-0125	`1327`	`1339`					Alibaba	Proprietary
🪙	Command A (03-2025)	`1327`	`1336`		`15`	`71.2`		Cohere	CC-BY-NC-4.0
🪙	Amazon-Nova-Chat-05-14	`1324`	`1337`		`17`	`73.3`		Amazon	Proprietary
🪙	Llama-3.1-Nemotron-Ultra-253B-v1	`1321`	`1345`		`24`	`82.5`		Nvidia	Nvidia Open
🪙	Step-2-16K-Exp	`1321`	`1313`					StepFun	Proprietary
🪙	Qwen3-30B-A3B	`1320`	`1346`		`21`	`77.7`		Alibaba	Apache 2.0
🪙	Gemini-1.5-Pro-002	`1320`	`1311`	`1158`	`17`	`75`	`0.8`	Google	Proprietary
🪙	o1-mini	`1318`	`1366`		`21`	`74.2`	`0.8`	OpenAI	Proprietary
🪙	o3-mini	`1318`	`1361`		`31`	`79.1`	`2.1`	OpenAI	Proprietary
🪙	Claude 3.7 Sonnet (thinking-32k)	`1316`	`1355`	`1167`	`25`	`83.7`	`0.9`	Anthropic	Proprietary
🪙	gpt-oss-20b	`1315`	`1371`		`27`	`73.6`		OpenAI	Apache 2.0
🪙	Hunyuan-Turbo-0110	`1314`	`1335`					Tencent	Proprietary
🪙	Llama-3.3-Nemotron-Super-49B-v1	`1310`	`1320`		`20`	`78.5`		Nvidia	Nvidia Open
🪙	OLMo-3-32b-think	`1306`	`1327`		`19`	`75.9`		Ai2	Apache-2.0
🪙	Grok-2-08-13	`1305`	`1298`		`13`	`70.9`		xAI	Grok 2
🪙	Gemma-3n-e4b-it	`1304`	`1297`		`8`	`48.8`		Google	Gemma
🪙	Yi-Lightning	`1303`	`1321`					01 AI	Proprietary
🪙	GPT-4o-2024-05-13	`1302`	`1307`	`1134`	`14`	`74.8`		OpenAI	Proprietary
🪙	Claude 3.7 Sonnet	`1301`	`1341`	`1145`	`18`	`80.3`		Anthropic	Proprietary
🪙	Claude 3.5 Sonnet (20241022)	`1299`	`1340`	`1122`	`15`	`77.2`		Anthropic	Proprietary
🪙	Deepseek-v2.5-1210	`1296`	`1316`		`11`	`67.2`		DeepSeek	DeepSeek
🪙	Athene-v2-Chat-72B	`1294`	`1320`					NexusFlow	NexusFlow
🪙	Gemma-3-4B-it	`1293`	`1265`		`6`	`41.7`		Google	Gemma
🪙	Llama-4-Maverick-17B-128E-Instruct	`1292`	`1312`	`1135`	`21`	`80.9`		Meta	Llama 4
🪙	GLM-4-Plus	`1292`	`1301`			`70.2`		Z.ai	Proprietary
🪙	Hunyuan-Large-2025-02-10	`1291`	`1311`					Tencent	Proprietary
🪙	Gemini-1.5-Flash-002	`1290`	`1273`	`1137`	`13`	`68`		Google	Proprietary
🪙	GPT-4o-mini-2024-07-18	`1289`	`1300`	`1063`	`11`	`64.8`		OpenAI	Proprietary
🪙	GPT-4.1-nano-2025-04-14	`1287`	`1312`	`1060`	`14`	`65.7`		OpenAI	Proprietary
🪙	Llama-3.1-405B-Instruct-bf16	`1286`	`1299`		`13`	`73.2`		Meta	Llama 3.1
🪙	Llama-3.1-Nemotron-70B-Instruct	`1285`	`1289`		`12`	`69`		Nvidia	Llama 3.1
🪙	Qwen-Max-0919	`1284`	`1296`					Alibaba	Proprietary
🪙	Llama-3.1-405B-Instruct-fp8	`1284`	`1292`		`13`	`73.2`		Meta	Llama 3.1
🪙	Yi-Lightning-lite	`1284`	`1286`					01 AI	Proprietary
🪙	Claude 3.5 Sonnet (20240620)	`1283`	`1309`	`1117`	`13`	`75.1`		Anthropic	Proprietary
🪙	Grok-2-mini-08-13	`1283`	`1279`					xAI	Proprietary
🪙	Llama-4-Scout-17B-16E-Instruct	`1276`	`1290`	`1126`	`15`	`75.2`		Meta	Llama 4
🪙	Hunyuan-Standard-2025-02-10	`1276`	`1289`					Tencent	Proprietary
🪙	Llama-3.3-70B-Instruct	`1276`	`1279`		`14`	`71.3`		Meta	Llama 3.3
🪙	Deepseek-v2.5	`1275`	`1306`		`10`	`66.2`		DeepSeek	DeepSeek
🪙	GPT-4-Turbo-2024-04-09	`1275`	`1280`	`1087`	`13`	`69.4`		OpenAI	Proprietary
🪙	Qwen2.5-72B-Instruct	`1272`	`1302`		`13`	`72`		Alibaba	Qwen
🪙	Hunyuan-Large-Vision	`1270`	`1298`	`1183`				Tencent	Proprietary
🪙	Mistral-Small-3.1-24B-Instruct-2503	`1269`	`1295`	`1121`	`11`	`65.9`		Mistral	Apache 2.0
🪙	Mistral-Large-2411	`1269`	`1284`		`12`	`69.7`		Mistral	MRL
🪙	Athene-70B	`1268`	`1274`					NexusFlow	CC-BY-NC-4.0
🪙	GPT-4-1106-preview	`1267`	`1269`		`11`	`63.7`		OpenAI	Proprietary
🪙	GPT-4-0125-preview	`1266`	`1261`					OpenAI	Proprietary
🪙	Claude 3 Opus	`1265`	`1269`	`1020`	`11`	`69.6`		Anthropic	Proprietary
🪙	Llama-3.1-70B-Instruct	`1265`	`1268`		`11`	`67.6`		Meta	Llama 3.1
🪙	Amazon Nova Pro 1.0	`1262`	`1282`	`979`	`13`	`69.1`		Amazon	Proprietary
🪙	Llama-3.1-Tulu-3-70B	`1260`	`1251`					Ai2	Llama 3.1
🪙	Claude 3.5 Haiku (20241022)	`1256`	`1287`	`1095`	`10`	`63.4`		Anthropic	Proprietary
🪙	magistral-medium-2506	`1253`	`1307`		`19`	`75.3`		Mistral	Proprietary
🪙	Reka-Core-20240904	`1252`	`1238`		`10`			Reka AI	Proprietary
🪙	Reka-Core-20240722	`1250`	`1226`					Reka AI	Proprietary
🪙	Qwen-Plus-0828	`1242`	`1263`					Alibaba	Proprietary
🪙	Jamba-1.5-Large	`1242`	`1244`		`8`	`57.2`		AI21 Labs	Jamba Open
🪙	Deepseek-v2-API-0628	`1240`	`1260`					DeepSeek	DeepSeek
🪙	Mistral-Small-3-24B-Instruct-2501	`1238`	`1251`		`11`	`65.2`		Mistral	Apache 2.0
🪙	Deepseek-Coder-v2-0724	`1237`	`1286`		`7`	`58.5`		DeepSeek	DeepSeek
🪙	Yi-Large	`1236`	`1238`		`7`	`58.6`		01 AI	Proprietary
🪙	Gemma-2-27B-it	`1236`	`1226`		`9`	`57.5`		Google	Gemma
🪙	Qwen2.5-Coder-32B-Instruct	`1235`	`1279`		`11`	`63.5`		Alibaba	Apache 2.0
🪙	Amazon Nova Lite 1.0	`1233`	`1253`	`989`	`11`	`59`		Amazon	Proprietary
🪙	Gemma-2-9B-it-SimPO	`1233`	`1211`					Princeton	MIT
🪙	Command R+ (08-2024)	`1233`	`1200`		`3`	`43.2`		Cohere	CC-BY-NC-4.0
🪙	Gemini-1.5-Flash-8B-001	`1231`	`1228`	`1042`	`8`	`56.9`		Google	Proprietary
🪙	Llama-3.1-Nemotron-51B-Instruct	`1231`	`1227`					Nvidia	Llama 3.1
🪙	GLM-4-0520	`1230`	`1237`					Z.ai	Proprietary
🪙	Nemotron-4-340B-Instruct	`1229`	`1220`					Nvidia	Nvidia Open
🪙	Aya-Expanse-32B	`1229`	`1211`		`3`	`37.7`		Cohere	CC-BY-NC-4.0
🪙	Reka-Flash-20240904	`1225`	`1208`		`10`			Reka AI	Proprietary
🪙	Llama-3-70B-Instruct	`1224`	`1216`		`7`	`57.4`		Meta	Llama 3
🪙	Claude 3 Sonnet	`1223`	`1232`	`983`	`7`	`57.9`		Anthropic	Proprietary
🪙	OLMo-2-0325-32B-Instruct	`1223`	`1215`		`7`	`51.1`		Ai2	Apache-2.0
🪙	Phi-4	`1222`	`1242`		`13`	`71.4`		Microsoft	MIT
🪙	Reka-Flash-20240722	`1218`	`1201`					Reka AI	Proprietary
🪙	Amazon Nova Micro 1.0	`1215`	`1228`		`9`	`53.1`		Amazon	Proprietary
🪙	Gemma-2-9B-it	`1213`	`1194`		`4`	`49.5`		Google	Gemma
🪙	Hunyuan-Standard-256K	`1209`	`1244`					Tencent	Proprietary
🪙	Command R+ (04-2024)	`1209`	`1184`		`3`	`42.7`		Cohere	CC-BY-NC-4.0
🪙	Qwen2-72B-Instruct	`1208`	`1206`		`9`	`62.2`		Alibaba	Qianwen
🪙	Claude 3 Haiku	`1200`	`1208`	`950`	`5`	`50`		Anthropic	Proprietary
🪙	Llama-3.1-Tulu-3-8B	`1200`	`1197`					Ai2	Llama 3.1
🪙	Qwen-Max-0428	`1199`	`1208`					Alibaba	Proprietary
🪙	Ministral-8B-2410	`1198`	`1219`		`4`	`38.9`		Mistral	MRL
🪙	GLM-4-0116	`1198`	`1209`					Z.ai	Proprietary
🪙	DeepSeek-Coder-V2-Instruct	`1196`	`1259`					DeepSeek	DeepSeek
🪙	Command R (08-2024)	`1195`	`1180`			`33.8`		Cohere	CC-BY-NC-4.0
🪙	Llama-3.1-8B-Instruct	`1193`	`1203`		`5`	`47.6`		Meta	Llama 3.1
🪙	Jamba-1.5-Mini	`1193`	`1197`					AI21 Labs	Jamba Open
🪙	Aya-Expanse-8B	`1193`	`1184`		`1`	`31.2`		Cohere	CC-BY-NC-4.0
🪙	Qwen1.5-110B-Chat	`1180`	`1192`		`5`			Alibaba	Qianwen
🪙	Yi-1.5-34B-Chat	`1178`	`1181`					01 AI	Apache-2.0
🪙	Claude-1	`1178`	`1161`					Anthropic	Proprietary
🪙	Qwen1.5-72B-Chat	`1172`	`1175`					Alibaba	Qianwen
🪙	Mistral Medium	`1171`	`1172`		`4`	`49.1`		Mistral	Proprietary
🪙	Llama-3-8B-Instruct	`1171`	`1164`		`3`	`40.5`		Meta	Llama 3
🪙	Command R (04-2024)	`1169`	`1141`			`33.7`		Cohere	CC-BY-NC-4.0
🪙	InternLM2.5-20B-chat	`1168`	`1179`					InternLM	Other
🪙	Mixtral-8x22b-Instruct-v0.1	`1168`	`1175`		`6`	`53.7`		Mistral	Apache 2.0
🪙	Gemma-2-2b-it	`1163`	`1130`					Google	Gemma
🪙	Granite-3.1-8B-Instruct	`1158`	`1191`					IBM	Apache 2.0
🪙	Claude-2.0	`1158`	`1160`		`4`	`48.6`		Anthropic	Proprietary
🪙	Gemini-1.0-Pro-001	`1155`	`1125`					Google	Proprietary
🪙	Zephyr-ORPO-141b-A35b-v0.1	`1150`	`1144`					HuggingFace	Apache 2.0
🪙	Claude-2.1	`1146`	`1158`		`5`	`49.5`		Anthropic	Proprietary
🪙	GPT-3.5-Turbo-0613	`1145`	`1164`		`4`	`46.2`		OpenAI	Proprietary
🪙	Qwen1.5-32B-Chat	`1144`	`1163`					Alibaba	Qianwen
🪙	Phi-3-Medium-4k-Instruct	`1144`	`1146`		`5`	`54.3`		Microsoft	MIT
🪙	Starling-LM-7B-beta	`1139`	`1151`					Nexusflow	Apache-2.0
🪙	Mixtral-8x7B-Instruct-v0.1	`1138`	`1136`		`1`	`38.7`		Mistral	Apache 2.0
🪙	GPT-3.5-Turbo-0314	`1138`	`1136`					OpenAI	Proprietary
🪙	Granite-3.1-2B-Instruct	`1136`	`1166`					IBM	Apache 2.0
🪙	Qwen1.5-14B-Chat	`1135`	`1144`					Alibaba	Qianwen
🪙	Claude-Instant-1	`1135`	`1136`			`43.4`		Anthropic	Proprietary
🪙	Yi-34B-Chat	`1134`	`1129`					01 AI	Yi
🪙	Tulu-2-DPO-70B	`1127`	`1120`					Ai2	Ai2 ImpACT
🪙	DBRX-Instruct-Preview	`1126`	`1141`					Databricks	DBRX
🪙	WizardLM-70B-v1.0	`1126`	`1093`					Microsoft	Llama 2
🪙	Llama-2-70B-chat	`1122`	`1099`		`3`	`40.7`		Meta	Llama 2
🪙	Nous-Hermes-2-Mixtral-8x7B-DPO	`1119`	`1103`					NousResearch	Apache-2.0
🪙	Llama-3.2-3B-Instruct	`1118`	`1097`		`2`	`34.7`		Meta	Llama 3.2
🪙	Phi-3-Small-8k-Instruct	`1117`	`1123`					Microsoft	MIT
🪙	OpenChat-3.5-0106	`1114`	`1119`					OpenChat	Apache-2.0
🪙	Starling-LM-7B-alpha	`1114`	`1104`					UC Berkeley	CC-BY-NC-4.0
🪙	Vicuna-33B	`1113`	`1091`					LMSYS	Non-commercial
🪙	DeepSeek-LLM-67B-Chat	`1111`	`1106`		`3`			DeepSeek	DeepSeek
🪙	Snowflake Arctic Instruct	`1109`	`1101`					Snowflake	Apache 2.0
🪙	Granite-3.0-8B-Instruct	`1108`	`1115`					IBM	Apache 2.0
🪙	NV-Llama2-70B-SteerLM-Chat	`1106`	`1047`					Nvidia	Llama 2
🪙	OpenChat-3.5	`1103`	`1077`					OpenChat	Apache-2.0
🪙	Gemma-1.1-7B-it	`1102`	`1105`					Google	Gemma
🪙	OpenHermes-2.5-Mistral-7B	`1100`	`1083`					NousResearch	Apache-2.0
🪙	pplx-70B-online	`1099`	`1055`					Perplexity AI	Proprietary
🪙	Mistral-7B-Instruct-v0.2	`1097`	`1094`			`24.5`		Mistral	Apache-2.0
🪙	Llama-2-13b-chat	`1093`	`1077`		`3`	`40.6`		Meta	Llama 2
🪙	Granite-3.0-2B-Instruct	`1091`	`1104`					IBM	Apache 2.0
🪙	SOLAR-10.7B-Instruct-v1.0	`1091`	`1073`					Upstage AI	CC-BY-NC-4.0
🪙	Qwen1.5-7B-Chat	`1090`	`1110`					Alibaba	Qianwen
🪙	Phi-3-Mini-4K-Instruct-June-24	`1088`	`1098`					Microsoft	MIT
🪙	Dolphin-2.2.1-Mistral-7B	`1088`	`1049`					Cognitive	Apache-2.0
🪙	WizardLM-13b-v1.2	`1084`	`1048`					Microsoft	Llama 2
🪙	Phi-3-Mini-4k-Instruct	`1082`	`1102`					Microsoft	MIT
🪙	MPT-30B-chat	`1076`	`1055`					MosaicML	CC-BY-NC-SA-4.0
🪙	Zephyr-7B-beta	`1076`	`1053`					HuggingFace	MIT
🪙	CodeLlama-34B-instruct	`1073`	`1065`					Meta	Llama 2
🪙	Llama-3.2-1B-Instruct	`1067`	`1063`			`20`		Meta	Llama 3.2
🪙	Qwen2.5-VL-32B-Instruct			`1149`				Alibaba	Apache 2.0
🪙	Step-1o-Vision-32k (highres)			`1119`				StepFun	Proprietary
🪙	Qwen2.5-VL-72B-Instruct			`1104`				Alibaba	Qwen
🪙	Pixtral-Large-2411			`1088`	`12`	`70.1`		Mistral	MRL
🪙	Qwen-VL-Max-1119			`1056`				Alibaba	Proprietary
🪙	Qwen2-VL-72b-Instruct			`1044`				Alibaba	Qwen
🪙	Step-1V-32K			`1043`				StepFun	Proprietary
🪙	Molmo-72B-0924			`1010`				Ai2	Apache 2.0
🪙	Pixtral-12B-2409			`1006`	`4`	`47.3`		Mistral	Apache 2.0
🪙	InternVL2-26B			`1003`				OpenGVLab	MIT
🪙	Llama-3.2-90B-Vision-Instruct			`997`	`10`	`67.1`		Meta	Llama 3.2
🪙	Hunyuan-Standard-Vision-2024-12-31			`996`				Tencent	Proprietary
🪙	Aya-Vision-32B			`992`				Cohere	CC-BY-NC-4.0
🪙	Qwen2-VL-7B-Instruct			`988`				Alibaba	Apache 2.0
🪙	Yi-Vision			`978`				01 AI	Proprietary
🪙	Llama-3.2-11B-Vision-Instruct			`964`	`5`	`46.4`		Meta	Llama 3.2
🪙	Molmo-7B-D-0924			`957`				Ai2	Apache 2.0

⚖️¹ Claude Opus 5 · GPT-5.6 Sol

🔨² Grok-4.6 · GPT-5.6 Terra

💻 Arena Elo ratings are computed by this notebook.

💡 AAII incorporates 10 evaluations: MMLU-Pro, GDPval-AA, 𝜏³-Banking, Terminal-Bench, SciCode, Humanity’s Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR.

ARC-AGI-2 Performance vs. Cost Explorer

Linear Log

⧉ Aligning task complexity to model capability:

Architect: The strategic brain—built for systemic design, deep planning, and high-horizon reasoning. ↩︎
Operator: The operational engine—built for workflow management, task routing, and rapid execution. ↩︎

Chatbot Arena +

❖ OproAI 2026Aug 16

❖ OproAI