🏆 HF Hub Benchmark Dashboard
Last updated: 2026-10-28T02:01:38 UTC · auto-refreshes every 6h
52 benchmarks
436 models
1,027 entries
45 active
7 empty
🧠 Knowledge · 3 benchmarks · 212 models
MMLU-Pro
50 entries↗ View on Hub
| Model | Score | In $/1M | Out $/1M | Context | TTFT | Throughput | License | Params | Providers | |
|---|---|---|---|---|---|---|---|---|---|---|
| 🥇 | FINAL-Bench/Darwin-180B-RSI | 88.12 | — | — | — | — | — | other | 180B | — |
| 🥈 | MiniMaxAI/MiniMax-M2.1 | 88 | — | — | — | — | — | other | 229B | — |
| 🥉 | internlm/Intern-S2-Preview | 88 | — | — | — | — | — | apache-2.0 | 36B | — |
| 4 | Qwen/Qwen3.5-397B-A17B | 87.8 | $0.45 | $3.00 | 262.1K | 403 ms | 87 t/s | apache-2.0 | 403B | novitafeatherless-aiscaleway +2 |
| 5 | deepseek-ai/DeepSeek-V4-Pro | 87.5 | $1.30 | $2.60 | 1.0M | 471 ms | 75 t/s | mit | 1599B | novitafeatherless-aideepinfra |
| 6 | moonshotai/Kimi-K2.5 | 87.1 | $0.45 | $2.25 | 262.1K | 592 ms | 46 t/s | other | 1027B | novitafeatherless-aideepinfra |
| 7 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 | 86.8 | $1.00 | $5.00 | 262.1K | 508 ms | 25 t/s | other | 561B | deepinfra |
| 8 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | 86.8 | — | — | — | — | — | other | 303B | — |
| 9 | Qwen/Qwen3.5-122B-A10B | 86.7 | $0.29 | $2.40 | 262.1K | 239 ms | 128 t/s | apache-2.0 | 125B | novitadeepinfra |
| 10 | deepseek-ai/DeepSeek-V4-Flash | 86.4 | $0.09 | $0.18 | 1.0M | 684 ms | 20 t/s | mit | 291B | featherless-aideepinfra |
| 11 | Qwen/Qwen3.6-27B | 86.2 | $0.32 | $3.19 | 262.1K | 389 ms | 62 t/s | apache-2.0 | 28B | featherless-aiovhclouddeepinfra |
| 12 | upstage/Solar-Open2-250B | 86.2 | — | — | — | — | — | other | 250B | — |
| 13 | Qwen/Qwen3.5-27B | 86.1 | $0.26 | $2.40 | 262.1K | 334 ms | 80 t/s | apache-2.0 | 28B | novitafeatherless-aideepinfra |
| 14 | zai-org/GLM-5 | 86 | $0.60 | $2.08 | 202.8K | 345 ms | 50 t/s | mit | 754B | novitafeatherless-aizai-org +1 |
| 15 | Qwen/Qwen3.6-35B-A3B | 85.2 | $0.10 | $0.95 | 262.1K | 415 ms | 167 t/s | apache-2.0 | 36B | featherless-aiscalewaydeepinfra |
| 16 | deepseek-ai/DeepSeek-R1-0528 | 85 | $0.50 | $2.15 | 163.8K | 605 ms | 36 t/s | mit | 685B | novitafeatherless-aideepinfra |
| 17 | zai-org/GLM-4.5 | 84.6 | — | — | — | 4,204 ms | 23 t/s | mit | 358B | zai-org |
| 18 | stepfun-ai/Step-3.5-Flash | 84.4 | $0.10 | $0.30 | 262.1K | 415 ms | 32 t/s | apache-2.0 | 199B | featherless-aideepinfra |
| 19 | deepseek-ai/DeepSeek-R1 | 84 | $0.70 | $2.50 | 64K | 831 ms | 42 t/s | mit | 684B | novita |
| 20 | LGAI-EXAONE/K-EXAONE-236B-A23B | 83.8 | — | — | — | — | — | other | 237B | — |
| 21 | nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 83.73 | — | — | — | — | — | other | 124B | — |
| 22 | RedHatAI/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 | 83.73 | — | — | — | — | — | other | 124B | — |
| 23 | internlm/Intern-S1 | 83.5 | — | — | — | — | — | apache-2.0 | 241B | — |
| 24 | LGAI-EXAONE/EXAONE-4.5-33B | 83.3 | — | — | — | — | — | other | 34B | — |
| 25 | Qwen/Qwen3-235B-A22B-Instruct-2507 | 83 | $0.20 | $0.60 | 32.8K | 364 ms | 89 t/s | apache-2.0 | 235B | nscalescaleway |
| 26 | ByteDance-Seed/Seed-OSS-36B-Instruct | 82.7 | — | — | — | — | — | apache-2.0 | 36B | — |
| 27 | meituan-longcat/LongCat-Flash-Chat | 82.7 | — | — | — | — | — | mit | 562B | — |
| 28 | MiniMaxAI/MiniMax-M2 | 82 | — | — | — | — | — | other | 229B | — |
| 29 | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 | 81.94 | — | — | — | — | — | other | 32B | — |
| 30 | nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 | 81.62 | — | — | — | — | — | other | 18B | — |
| 31 | skt/A.X-K1 | 81.5 | — | — | — | — | — | apache-2.0 | 519B | — |
| 32 | zai-org/GLM-4.5-Air | 81.4 | $0.13 | $0.85 | 131.1K | 590 ms | 84 t/s | mit | 110B | novitazai-org |
| 33 | deepseek-ai/DeepSeek-V3-0324 | 81.2 | $0.24 | $0.90 | 163.8K | 429 ms | 66 t/s | mit | 685B | featherless-aideepinfra |
| 34 | MiniMaxAI/MiniMax-M1-40k | 81.1 | — | — | — | — | — | apache-2.0 | 456B | — |
| 35 | jdopensource/JoyAI-LLM-Flash | 81.02 | — | — | — | — | — | — | 49B | — |
| 36 | moonshotai/Kimi-K2-Instruct | 81 | $0.57 | $2.30 | 131.1K | 1,430 ms | 70 t/s | other | 1026B | novitafeatherless-ai |
| 37 | Qwen/Qwen3-30B-A3B-Thinking-2507 | 80.9 | — | — | — | — | — | apache-2.0 | 31B | — |
| 38 | openai/gpt-oss-120b | 80.8 | $0.04 | $0.17 | 131.1K | 160 ms | 1197 t/s | apache-2.0 | 117B | groqnovitacerebras +6 |
| 39 | MiniMaxAI/MiniMax-M2.5 | 80.1 | $0.30 | $1.20 | 204.8K | 1,019 ms | 42 t/s | other | 229B | novitafeatherless-ai |
| 40 | baidu/ERNIE-4.5-300B-A47B-PT | 78.4 | — | — | — | — | — | apache-2.0 | 300B | — |
| 41 | meituan-longcat/LongCat-Flash-Lite | 78.29 | — | — | — | — | — | mit | 69B | — |
| 42 | MiniMaxAI/MiniMax-Text-01 | 75.7 | — | — | — | — | — | — | 456B | — |
| 43 | openai/gpt-oss-20b | 73.6 | $0.03 | $0.14 | 131.1K | 371 ms | 640 t/s | apache-2.0 | 21B | groqnscalefeatherless-ai +2 |
| 44 | Qwen/Qwen2.5-72B | 71.59 | — | — | — | — | — | other | 73B | — |
| 45 | microsoft/phi-4 | 70.4 | $0.07 | $0.14 | 16.4K | 455 ms | 99 t/s | mit | 15B | featherless-aideepinfra |
| 46 | Qwen/Qwen3-4B-Instruct-2507 | 69.6 | $0.01 | $0.03 | 262.1K | 333 ms | 149 t/s | apache-2.0 | 4B | nscale |
| 47 | baidu/ERNIE-4.5-300B-A47B-Base-PT | 69.5 | — | — | — | — | — | apache-2.0 | 299B | — |
| 48 | Qwen/Qwen2.5-32B | 69.23 | — | — | — | — | — | apache-2.0 | 33B | — |
| 49 | XiaomiMiMo/MiMo-V2.5-Pro | 68.5 | $1.00 | $3.00 | 1.0M | 941 ms | 27 t/s | mit | 1023B | deepinfra |
| 50 | Qwen/Qwen3-235B-A22B | 68.18 | $0.20 | $0.60 | 32K | 565 ms | 18 t/s | apache-2.0 | 235B | nscalefeatherless-ai |