Groq: Models Intelligence, Performance & Price

Groq
Groq

This analysis is intended to support you in choosing the best model provided by Groq for your use-case.

Most Intelligent

#1
gpt-oss-120b (high)gpt-oss-120b (high)
4

Intelligence Index

Total 6 models

Lowest Time per Task

#1
gpt-oss-120b (high)gpt-oss-120b (high)
3.1 min

Time per Intelligence Index task (minutes)

Total 6 models

Lowest Price

#1
Llama 3.1 8BLlama 3.1 8B
$0.05
#2
gpt-oss-20b (low)gpt-oss-20b (low)
$0.10
#3
gpt-oss-20b (high)gpt-oss-20b (high)
$0.10
#4
gpt-oss-120b (high)gpt-oss-120b (high)
$0.14
#5
gpt-oss-120b (low)gpt-oss-120b (low)
$0.20

Blended price (per 1M tokens)

Total 6 models

Groq offers 6 models, each with different intelligence, performance, and pricing characteristics. Below is a comparison of the key metrics across models.

  • For latency, gpt-oss-120b (low) (1.30s), Llama 3.3 70B (1.33s), and gpt-oss-20b (low) (1.37s) offer the lowest time to first answer token.
  • For pricing, Llama 3.1 8B ($0.05), gpt-oss-20b (low) ($0.10), and gpt-oss-20b (high) ($0.10) offer the lowest blended prices per 1M tokens. Prices vary up to 3.8x across models.
  • For context window size, gpt-oss-120b (high) (131k), gpt-oss-20b (low) (131k), and gpt-oss-20b (high) (131k) support the largest context windows on Groq.
Artificial Analysis Intelligence Index · Higher is better
Inference time (minutes) per Intelligence Index task · Lower is better
USD per 1M tokens (blended) · Lower is better

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Evaluations

Evaluations measured independently by Artificial Analysis · AA-PersonalityBench scores are percentile ranks from 1 to 100
See more

Agentic knowledge work, Elo

Agentic SaaS workflows

Agentic scientific research workflows in a terminal

Agentic software engineering in open-source repositories

Reasoning & knowledge

Professional document reasoning, All-pass

Agentic coding & terminal use

Physics reasoning

Quantitative analysis on spreadsheets & documents

No data available

Legal agentic work, Hallucination-Gated All-Pass Rate

No data available

Agentic business operations

Agentic real-world work tasks, Elo

Agentic interactive 3D experiences, Elo

No data available

Product and brand videos designed in code, Elo

No data available

Kubernetes incident root-cause analysis

Medical long context reasoning

Visual reasoning

No data available

Rich, varied, well-crafted language

No data available

Well-structured, scannable, answer-first

No data available

Truthful, acknowledges uncertainty, non-sycophantic

No data available

Use of filler and generic language

No data available

Intelligence Index vs. Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended)
Most attractive quadrant

Pricing

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Intelligence Index vs. Price

Blended at 7:2:1 (cache-input-output) · USD per 1M tokens (blended)
Most attractive quadrant

Speed

Average of the single-request and multi-turn agentic workloads measured

Time per Intelligence Index Task

Output tokens divided by end-to-end output speed (minutes per Intelligence Index task) · Lower is better

Quality

Endpoint Accuracy Index

Each endpoint's accuracy as a % of its model's reference endpoint · Color shows whether the gap is statistically significant

Latency

Average of the single-request and multi-turn agentic workloads measured

Time to First Answer Token

Seconds until the first answer token after any reasoning · Average of the single-request and multi-turn agentic workloads measured · Lower is better

Reliability

Share of requests the endpoint failed, across all the single-request and multi-turn agentic workloads measured

Endpoint Error Rate

Share of requests the endpoint failed with an error, a rate limit or a timeout · Across all the single-request and multi-turn agentic workloads measured · Lower is better

Caching

Cache Hit Rate

Median across multi-turn agentic session runs in the last four weeks, updated Oct 26, 2026 · Higher is better

Cost per Task vs. Cache Hit Rate

Weighted average cost (USD) per Intelligence Index task · Cache hit rate: median of the last four weeks, updated Oct 26, 2026
Most attractive quadrant

Further Analysis
OpenAI logo
gpt-oss-120b (high)
4
$0.32
3.2
5.54
1.6%
131k
Open
OpenAI logo
gpt-oss-20b (low)
--
--
--
1.48
4.3%
131k
Open
OpenAI logo
gpt-oss-20b (high)
--
--
--
7.55
4.0%
131k
Open
Meta logo
Llama 3.1 8B
--
--
--
1.49
0.0%
131k
Open
Meta logo
Llama 3.3 70B
--
--
--
1.36
0.7%
131k
Open
OpenAI logo
gpt-oss-120b (low)
--
--
--
1.32
4.3%
131k
Open

Key definitions

Frequently Asked Questions

Common questions about Groq