Comparison of Open Source Models
Comparison and analysis of open source AI models across key performance metrics including quality, performance, inference speed, context window, parameter count & licensing details.
Models are considered open source (also commonly referred to as open weights) where their weights are accessible to download. This allows self-hosting on your own infrastructure and enables customizing the model such as through fine-tuning.
For more details relating to our methodology, see our FAQs.
Openness
Artificial Analysis Openness Index: Score
Open Source Progress
Open Weights vs. Proprietary: Artificial Analysis Progress Index, Over Time
Open Source: Artificial Analysis Progress Index by Lab, Over Time
Open Source: Artificial Analysis Progress Index by Size, Over Time
Intelligence
Artificial Analysis Intelligence Index
Evaluations
Agentic knowledge work, Elo
Knowledge
1 - hallucination rate
Agentic SaaS workflows
Agentic scientific research workflows in a terminal
Agentic software engineering in open-source repositories
Reasoning & knowledge
Professional document reasoning, All-pass
Agentic coding & terminal use
Physics reasoning
Quantitative analysis on spreadsheets & documents
Legal agentic work, Hallucination-Gated All-Pass Rate
Agentic business operations
Agentic real-world work tasks, Elo
Agentic interactive 3D experiences, Elo
Product and brand videos designed in code, Elo
Kubernetes incident root-cause analysis
Medical long context reasoning
Visual reasoning
Rich, varied, well-crafted language
Well-structured, scannable, answer-first
Truthful, acknowledges uncertainty, non-sycophantic
Use of filler and generic language
Size
Intelligence Index By Model Size
Model Size: Total and Active Parameters
Intelligence Index vs. Active Parameters
Intelligence Index vs. Total Parameters
Context Window
Context Window
Further details
Weights | Provider Benchmarks | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
Kimi K3.1 Pro | 46 | 2.8T 104B active at inference time | 1M | $1.54 | 38.8 | 31 | +15 | |||
DeepSeek V4.1 Flash 1017 (Max) | 33 | 552B 16B active at inference time | 1M | $0.18 | 13.1 | 177 | +23 | |||
GLM-5.3 (Max) | 32 | 753B 40B active at inference time | 1M | $0.90 | 22.2 | 89 | +26 | |||
Inkling 2 Small | 31 | 594B 17B active at inference time | 1M | $0.18 | 21.6 | 116 | ||||
MiMo-V2.6-Pro | 30 | 1T 42B active at inference time | 1M | $0.18 | 37.1 | 54 | ||||
Ling 3.1 Flash 1019 | 30 | 560B 25B active at inference time | 1M | $0.19 | - | - | ||||
Mistral Large 4 (High) | 26 | 1.1T 52B active at inference time | 1M | $0.40 | 18.0 | 76 | ||||
Qwen3.8 27B (Xhigh) | 20 | 27B | 256k | $0.47 | 37.4 | 49 | +7 | |||
K2 Horizon 375B A23B | 18 | 375B 23B active at inference time | 524k | $0.00 | 5.1 | 207 | ||||
Beam 1.0 | 18 | 501B 23B active at inference time | 1M | $0.23 | 2.0 | 281 | +2 | |||
Nemotron 3.5 Super VL | 14 | 120B 12B active at inference time | 1M | $0.13 | 4.7 | 291 | +6 |