Chatbot Arena +
❖ This leaderboard is based on the following benchmarks. Arena + — an agent-driven battle platform for large language models (LLMs), with Bradley-Terry Elo ratings computed from LLM-as-a-judge votes. MII — Model Intelligence Index, combining Arena Elo and Agent Intelligence (scored on real-world, multi-step workflows and coding tasks). ARC-AGI-2 — an Artificial General Intelligence benchmark that measures fluid intelligence.
Agent Harnesses
❖ Curated, ranked list of AI agent harnesses (the runtimes that close the loop between a stateless model and the outside world), orchestration frameworks, and harness techniques for reliable agentic systems. 160+ harnesses · 12 categories · weekly-rescored · MCP-ready : claude mcp add agent-harnesses -- uvx agent-harnesses-mcp
SWE-bench +
❖ SWE-bench is a benchmark for evaluating large language models on real world software issues collected from GitHub. Given a codebase and an issue, a language model is tasked with generating a patch that resolves the described problem. SWE-bench Verified is a human-validated subset that more reliably evaluates AI models’ ability to solve issues. International Olympiad in Informatics (IOI) competition features standardized and automated grading.
Text2SQL Leaderboard
❖ Text-to-SQL (or Text2SQL), as the name implies, is to convert text into SQL. A more academic definition is to convert natural language problems in the database field into structured query languages that can be executed in relational databases. Therefore, Text-to-SQL can also be abbreviated as NL2SQL. Input: natural language questions, such as Query the relevant information of the table t_user, and the results are sorted in descending order by id. Output: SQL, such as SELECT * FROM t_user ORDER BY id DESC.