PrimaLabs: Models Intelligence, Performance & Price

PrimaLabs
PrimaLabs

This analysis is intended to support you in choosing the best model provided by PrimaLabs for your use-case.

Most Intelligent

#1
Kimi K3.1 ProKimi K3.1 Pro
46
#2
DeepSeek V4.1 Flash 1017 (max)DeepSeek V4.1 Flash 1017 (max)
33
#3
MiMo-V2.6-ProMiMo-V2.6-Pro
30
#4
GLM-5.3-FlashGLM-5.3-Flash
28
#5
Nemotron 3.5 Super VL (NVFP4)Nemotron 3.5 Super VL (NVFP4)
14

Intelligence Index

Total 6 models

Lowest Time per Task

#1
Nemotron 3.5 Lightning (NVFP4)Nemotron 3.5 Lightning (NVFP4)
2.8 min
#2
Nemotron 3.5 Super VL (NVFP4)Nemotron 3.5 Super VL (NVFP4)
4.1 min
#3
MiMo-V2.6-ProMiMo-V2.6-Pro
7.9 min
#4
Kimi K3.1 ProKimi K3.1 Pro
11.0 min
#5
DeepSeek V4.1 Flash 1017 (max)DeepSeek V4.1 Flash 1017 (max)
11.2 min

Time per Intelligence Index task (minutes)

Total 6 models

Lowest Price

#1
GLM-5.3-FlashGLM-5.3-Flash
$0.10
#2
Nemotron 3.5 Lightning (NVFP4)Nemotron 3.5 Lightning (NVFP4)
$0.10
#3
DeepSeek V4.1 Flash 1017 (max)DeepSeek V4.1 Flash 1017 (max)
$0.15
#4
Nemotron 3.5 Super VL (NVFP4)Nemotron 3.5 Super VL (NVFP4)
$0.24
#5
Kimi K3.1 ProKimi K3.1 Pro
$1.39

Blended price (per 1M tokens)

Total 6 models

PrimaLabs offers 6 models, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across models.

  • For intelligence, the top models on PrimaLabs are Kimi K3.1 Pro (46), DeepSeek V4.1 Flash 1017 (max) (33), and MiMo-V2.6-Pro (30).
  • For time per task, Nemotron 3.5 Lightning (NVFP4) (2.8 min), Nemotron 3.5 Super VL (NVFP4) (4.1 min), and MiMo-V2.6-Pro (7.9 min) finish an Intelligence Index task fastest on PrimaLabs. Time per task varies significantly across models, with the slowest taking 4.0x longer than the quickest.
  • For latency, Nemotron 3.5 Lightning (NVFP4) (5.79s), MiMo-V2.6-Pro (6.32s), and Nemotron 3.5 Super VL (NVFP4) (8.48s) offer the lowest time to first answer token.
  • For pricing, GLM-5.3-Flash ($0.10), Nemotron 3.5 Lightning (NVFP4) ($0.10), and DeepSeek V4.1 Flash 1017 (max) ($0.15) offer the lowest blended prices per 1M tokens. Prices vary up to 13.9x across models.
  • For context window size, Kimi K3.1 Pro (1M), DeepSeek V4.1 Flash 1017 (max) (1M), and MiMo-V2.6-Pro (1M) support the largest context windows on PrimaLabs.
Artificial Analysis Intelligence Index · Higher is better
Inference time (minutes) per Intelligence Index task · Lower is better
USD per 1M tokens (blended) · Lower is better

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Evaluations

Evaluations measured independently by Artificial Analysis · AA-PersonalityBench scores are percentile ranks from 1 to 100
See more

Agentic knowledge work, Elo

Agentic SaaS workflows

Agentic scientific research workflows in a terminal

Agentic software engineering in open-source repositories

Reasoning & knowledge

Professional document reasoning, All-pass

Agentic coding & terminal use

Physics reasoning

Quantitative analysis on spreadsheets & documents

Legal agentic work, Hallucination-Gated All-Pass Rate

Agentic business operations

Agentic real-world work tasks, Elo

Agentic interactive 3D experiences, Elo

Product and brand videos designed in code, Elo

Kubernetes incident root-cause analysis

Medical long context reasoning

Visual reasoning

Rich, varied, well-crafted language

Well-structured, scannable, answer-first

Truthful, acknowledges uncertainty, non-sycophantic

Use of filler and generic language

Intelligence Index vs. Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended)
Most attractive quadrant
Pareto line

Pricing

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Intelligence Index vs. Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended)
Most attractive quadrant
Pareto line

Speed

Average of the single-request and multi-turn agentic workloads measured

Time per Intelligence Index Task

Output tokens divided by end-to-end output speed (minutes per Intelligence Index task) · Lower is better

Quality

Endpoint Accuracy Index

Each endpoint's accuracy as a % of its model's reference endpoint · Color shows whether the gap is statistically significant

Latency

Average of the single-request and multi-turn agentic workloads measured

Time to First Answer Token

Seconds until the first answer token after any reasoning · Average of the single-request and multi-turn agentic workloads measured · Lower is better

Reliability

Share of requests the endpoint failed, across all the single-request and multi-turn agentic workloads measured

Endpoint Error Rate

Share of requests the endpoint failed with an error, a rate limit or a timeout · Across all the single-request and multi-turn agentic workloads measured · Lower is better

Caching

Cache Hit Rate

Median across multi-turn agentic session runs in the last four weeks, updated Oct 26, 2026 · Higher is better

Cost per Task vs. Cache Hit Rate

Weighted average cost (USD) per Intelligence Index task · Cache hit rate: median of the last four weeks, updated Oct 26, 2026
Most attractive quadrant
Pareto line

Further Analysis
Kimi logo
Kimi K3.1 Pro
46
$2.94
9.0
41.60
8.4%
1M
Open
DeepSeek logo
DeepSeek V4.1 Flash 1017 (max)
33
$0.56
11.5
36.12
1.3%
1M
Open
Xiaomi logo
MiMo-V2.6-Pro
30
$2.56
9.0
10.62
0.0%
1M
Open
Z AI logo
GLM-5.3-Flash
28
$0.90
12.5
28.77
1.3%
1M
Open
NVIDIA logo
Nemotron 3.5 Super VL (NVFP4)
14
$0.45
3.9
9.67
0.0%
1M
Open
NVIDIA logo
Nemotron 3.5 Lightning (NVFP4)
6
$0.55
2.9
5.88
10.7%
1M
Open

Key definitions

Frequently Asked Questions

Common questions about PrimaLabs