OpenBMB Models: Intelligence, Performance & Price
Artificial Analysis Intelligence Index
Per Intelligence Index Task
Per Intelligence Index Task
Artificial Analysis has benchmarked 4 models from OpenBMB. Below is a comparison of the key metrics across these models.
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Task
Cost
Cost per Intelligence Index Task
Performance
Time per Intelligence Index Task
Capability Scores
Capability Indexes
Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better
Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better
Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better
Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Briefcase v1.1 · Higher is better
Incorporates 4 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf · Higher is better
All OpenBMB Releases
Further details
Weights | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| MiniCPM-V 4.6 1.3B | - | 1.3B | 262k | - | - | - | - | ||
| MiniCPM5-2B | - | 2.6B | 131k | - | - | - | - | ||
| MiniCPM5-1B (Reasoning) | - | 1B | 128k | - | - | - | - | ||
| MiniCPM5-1B (Non-reasoning) | - | 1B | 128k | - | - | - | - |