This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.

Meta has launched a newer release, Llama 3.2 Instruct 11B (Vision). We suggest considering it instead.

•

Open weights model

•

Released July 2024

Llama 3.1 Instruct 8B API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Llama 3.1 Instruct 8B for your use-case.

Lowest Time per Task

Time per Intelligence Index task (minutes)

6 endpoints from 5 providers

Lowest Cost per Task

Cost per Intelligence Index task

6 endpoints from 5 providers

Llama 3.1 8B is available through 6 API endpoints from 5 providers, each offering different performance characteristics and pricing. Below is a comparison of the key metrics across providers.

    Inference time (minutes) per Intelligence Index task · Lower is better
    No data available
    Weighted average cost (USD) per Intelligence Index task · Lower is better
    No data available

    Pricing

    Cost per Intelligence Index Task: Llama 3.1 Instruct 8B

    Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
    No data available

    Pricing: Cache Hit, Input, and Output: Llama 3.1 Instruct 8B

    Price (USD per M Tokens) · Lower is better

    Output Speed vs. Cost per Task: Llama 3.1 Instruct 8B

    Output speed: output tokens divided by total request time, including time to first token · Weighted average cost (USD) per Intelligence Index task
    Most attractive quadrant
    No data available

    Speed

    Average of the single-request and multi-turn agentic workloads measured

    Output Speed: Llama 3.1 Instruct 8B

    Output tokens divided by total request time · Includes time to first token · Average of the single-request and multi-turn agentic workloads measured · Higher is better

    Latency

    Average of the single-request and multi-turn agentic workloads measured

    Time to First Answer Token: Llama 3.1 Instruct 8B

    Seconds until the first answer token after any reasoning · Average of the single-request and multi-turn agentic workloads measured · Lower is better

    Reliability

    Share of requests the endpoint failed, across all the single-request and multi-turn agentic workloads measured

    Endpoint Error Rate: Llama 3.1 Instruct 8B

    Share of requests the endpoint failed with an error, a rate limit or a timeout · Across all the single-request and multi-turn agentic workloads measured · Lower is better

    Caching

    Cache Hit Rate: Llama 3.1 Instruct 8B

    Median across multi-turn agentic session runs in the last four weeks, updated Oct 26, 2026 · Higher is better

    Cost per Task vs. Cache Hit Rate: Llama 3.1 Instruct 8B

    Weighted average cost (USD) per Intelligence Index task · Cache hit rate: median of the last four weeks, updated Oct 26, 2026
    Most attractive quadrant
    No data available

    Key Comparison Metrics & API Features

    Amazon Bedrock logoAmazon Bedrock
    --
    --
    --
    --
    128k
    Open
    CoreWeave logoCoreWeave
    --
    --
    1.41
    4.0%
    128k
    Open
    DeepInfra logoDeepInfra
    --
    --
    17.80
    2.0%
    131k
    Open
    DeepInfra logoDeepInfra
    --
    --
    31.38
    0.0%
    131k
    Open
    Groq logoGroq
    --
    --
    1.49
    0.0%
    131k
    Open
    Novita logoNovita
    --
    --
    1.45
    0.0%
    16k
    Open

    Frequently Asked Questions

    Common questions about Llama 3.1 Instruct 8B providers