This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.

Anthropic has launched a newer release, Claude 3.5 Haiku. We suggest considering it instead.

All Releases••

Proprietary model

•

Released March 2024

Claude 3 Haiku: Intelligence, Performance & Price Analysis

Available providers

Model summary

N/A
Artificial Analysis Intelligence Index
Unknown out of 4 units for Intelligence.

Performance

N/A
Time per Intelligence Index task (minutes)
Unknown out of 4 units for Performance.
In $0.25Out $1.25
N/A
Cost per Intelligence Index task
Unknown out of 4 units for Cost.

Verbosity

N/A
Output tokens from Intelligence Index
Unknown out of 4 units for Verbosity.

Claude 3 Haiku supports text and image input, outputs text, and has a 200k tokens context window with knowledge up to August 2023.

Pricing for Claude 3 Haiku is $0.25 per 1M input tokens (somewhat expensive, median: $0.24) and $1.25 per 1M output tokens (somewhat expensive, median: $0.70).

Artificial Analysis Intelligence Index · Higher is better
No publicly available API

Time per Task

Inference time (minutes) per Intelligence Index task · Lower is better
No publicly available API
Weighted average cost (USD) per Intelligence Index task · Lower is better
No publicly available API

Intelligence

Artificial Analysis Intelligence Index

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Artificial Analysis Intelligence Index by Open Weights / Proprietary

Artificial Analysis Intelligence Index v5.0.1 incorporates 9 evaluations: AA-Briefcase v1.1, AutomationBench-AA, Terminal-Bench 4.0, FrontierCode-AA 2.0, AA-Omniscience v1.1, GDP.pdf, HLE-Diamond, CritPt v2 (Hard Subset), and Terminal-Bench-Science 0.1

Intelligence Index vs. Cost per Task

Artificial Analysis Intelligence Index · Weighted average cost (USD) per Artificial Analysis Intelligence Index task
Most attractive quadrant
Pareto line

Evaluations

Intelligence evaluations measured independently by Artificial Analysis · Higher is better
See more

Visual reasoning

Cost

Cost per Intelligence Index Task

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better

Cost to Run Artificial Analysis Intelligence Index

Cost (USD) to run all evaluations in the Artificial Analysis Intelligence Index

Pricing: Cache Hit, Input, and Output

Price (USD per M Tokens)

Context Window

Context Window

Context window: tokens limit · Higher is better

Further details

Weights
Claude 3 Haiku
Anthropic logoAnthropic
-
-
200k
$0.35
-
-
Not available
Amazon Bedrock

Frequently Asked Questions

Common questions about Claude 3 Haiku