This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.

Nous Research has launched a newer release, Hermes 4 - Llama-3.1 70B. We suggest considering it instead.

•

Open weights model

•

Released August 2024

Hermes 3 - Llama-3.1 70B API Provider Benchmarking & Analysis

Model Comparison

This analysis is intended to support you in choosing the best API provider of Hermes 3 - Llama-3.1 70B for your use-case.

Lowest Time per Task

Time per Intelligence Index task (minutes)

Total 1 provider

Lowest Cost per Task

Cost per Intelligence Index task

Total 1 provider

Hermes 3 - Llama-3.1 70B is available through DeepInfra.

Inference time (minutes) per Intelligence Index task · Lower is better
No data available
Weighted average cost (USD) per Intelligence Index task · Lower is better
No data available

Pricing

Cost per Intelligence Index Task: Hermes 3 - Llama-3.1 70B

Weighted average cost (USD) per Intelligence Index task · Segmented by token type · Lower is better
No data available

Pricing: Cache Hit, Input, and Output: Hermes 3 - Llama-3.1 70B

Price (USD per M Tokens) · Lower is better

Output Speed vs. Cost per Task: Hermes 3 - Llama-3.1 70B

Output speed: output tokens divided by total request time, including time to first token · Weighted average cost (USD) per Intelligence Index task
Most attractive quadrant
No data available

Speed

Average of the single-request and multi-turn agentic workloads measured

Output Speed: Hermes 3 - Llama-3.1 70B

Output tokens divided by total request time · Includes time to first token · Average of the single-request and multi-turn agentic workloads measured · Higher is better

Latency

Average of the single-request and multi-turn agentic workloads measured

Time to First Answer Token: Hermes 3 - Llama-3.1 70B

Seconds until the first answer token after any reasoning · Average of the single-request and multi-turn agentic workloads measured · Lower is better

Reliability

Share of requests the endpoint failed, across all the single-request and multi-turn agentic workloads measured

Endpoint Error Rate: Hermes 3 - Llama-3.1 70B

Share of requests the endpoint failed with an error, a rate limit or a timeout · Across all the single-request and multi-turn agentic workloads measured · Lower is better

Key Comparison Metrics & API Features

DeepInfra logoDeepInfra
--
--
0.90
0.0%
131k
Open

Frequently Asked Questions

Common questions about Hermes 3 - Llama-3.1 70B providers