This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.

Mistral has launched a newer release, Mistral Small 3.2. We suggest considering it instead.

•

Open weights model

•

Released December 2023

Mixtral 8x7B Instruct API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Mixtral 8x7B Instruct for your use-case.

Lowest Time per Task

Time per Intelligence Index task (minutes)

Total 1 provider

Lowest Cost per Task

Cost per Intelligence Index task

Total 1 provider

Mixtral 8x7B is available through Amazon.

Inference time (minutes) per Intelligence Index task · Lower is better
No data available
Weighted average cost (USD) per Intelligence Index task · Lower is better
No data available

Pricing

Cost per Intelligence Index Task: Mixtral 8x7B Instruct

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
No data available

Pricing: Cache Hit, Input, and Output: Mixtral 8x7B Instruct

Price (USD per M Tokens) · Lower is better

Output Speed vs. Cost per Task: Mixtral 8x7B Instruct

Output speed: output tokens divided by total request time, including time to first token · Weighted average cost (USD) per Intelligence Index task
Most attractive quadrant
No data available

Speed

Average of the single-request and multi-turn agentic workloads measured

Output Speed: Mixtral 8x7B Instruct

Output tokens divided by total request time · Includes time to first token · Average of the single-request and multi-turn agentic workloads measured · Higher is better

Latency

Average of the single-request and multi-turn agentic workloads measured

Time to First Answer Token: Mixtral 8x7B Instruct

Seconds until the first answer token after any reasoning · Average of the single-request and multi-turn agentic workloads measured · Lower is better

Reliability

Share of requests the endpoint failed, across all the single-request and multi-turn agentic workloads measured

Endpoint Error Rate: Mixtral 8x7B Instruct

Share of requests the endpoint failed with an error, a rate limit or a timeout · Across all the single-request and multi-turn agentic workloads measured · Lower is better

Key Comparison Metrics & API Features

Amazon Bedrock logoAmazon Bedrock
--
--
0.71
0.0%
33k
Open

Frequently Asked Questions

Common questions about Mixtral 8x7B Instruct providers