Allen Institute for AI Models: Intelligence, Performance & Price
Artificial Analysis Intelligence Index
Per Intelligence Index Task
Per Intelligence Index Task
Artificial Analysis has benchmarked 10 models from Allen Institute for AI. Below is a comparison of the key metrics across these models.
Intelligence
Artificial Analysis Intelligence Index
Intelligence Index vs. Cost per Task
Cost
Cost per Intelligence Index Task
Performance
Time per Intelligence Index Task
Capability Scores
Capability Indexes
Incorporates 5 evaluations: AA-Briefcase v1.1, AA-Omniscience v1.1, HLE-Diamond, AutomationBench-AA, GDP.pdf · Higher is better
Incorporates 4 evaluations: AutomationBench-AA, AA-Briefcase v1.1, AA-Omniscience v1.1, GDP.pdf · Higher is better
Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf, AutomationBench-AA · Higher is better
Incorporates 5 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, MLCR-AA, AutomationBench-AA, HLE-Diamond · Higher is better
Incorporates 7 evaluations: AA-Omniscience v1.1, CritPt v2 (Hard Subset), Terminal-Bench-Science 0.1, HLE-Diamond, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Briefcase v1.1 · Higher is better
Incorporates 4 evaluations: AA-Omniscience v1.1, AA-Briefcase v1.1, HLE-Diamond, GDP.pdf · Higher is better
All Allen Institute for AI Releases
Further details
Weights | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| Olmo 3 7B Think | - | 7B | 66k | - | - | - | - | ||
| Olmo 3.1 32B Think | - | 32.2B | 66k | - | - | - | - | ||
| Molmo2-8B | - | 8.7B | 37k | - | - | - | - | ||
| OLMo 2 32B | - | 32.2B | 4k | - | - | - | - | ||
| Olmo 3 7B Instruct | - | 7B | 66k | - | - | - | - | ||
| Olmo 3.1 32B Instruct | - | 32.2B | 66k | - | - | - | - | ||
| Molmo 7B-D | - | 8B | 4k | - | - | - | - | ||
| Olmo 3 32B Think | - | 32.2B | 66k | - | - | - | - | ||
| Llama 3.1 Tulu3 405B | - | 405B | 128k | - | - | - | - | ||
| OLMo 2 7B | - | 7.3B | 4k | - | - | - | - |