This model is deprecated. We still benchmark its performance, but less often: every 18 hours instead of every 6.
NVIDIA has launched a newer release, Nemotron 3 Super 120B A12B. We suggest considering it instead.
Llama 3.1 Nemotron Instruct 70B: Intelligence, Performance & Price Analysis
Model summary
Performance
Verbosity
Llama 3.1 Nemotron Instruct 70B supports text input, outputs text, and has a 128k tokens context window with knowledge up to December 2023.
| Reasoning | No |
|---|---|
| Input modality | Supports: text |
| Output modality | Supports: text |
| Knowledge cutoff | Dec 1, 2023 |
| Context window | 128k ~192 A4 pages of size 12 Arial font |
| Total parameters | 70B |
| License | LLAMA 3.1 COMMUNITY LICENSE AGREEMENT |
| Model weights | Hugging Face |
Metrics are compared against models of the same class:
- Non-reasoning models → compared only with other non-reasoning models
- Reasoning models → compared across both reasoning and non-reasoning
- Open weights models → compared only with other open weights models of the same size class:
- Tiny: ≤4B parameters
- Small: 4B–40B parameters
- Medium: 40B–150B parameters
- Large: >150B parameters
- Proprietary models → compared across proprietary and open weights models of the same price range, using a blended 3:1 input/output price ratio:
- <$0.15 per 1M tokens
- $0.15–$1 per 1M tokens
- >$1 per 1M tokens
Time per Task
Intelligence
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index by Open Weights / Proprietary
Intelligence Index vs. Cost per Task
Openness Index
Artificial Analysis Openness Index: Score
Cost
Cost per Intelligence Index Task
Cost to Run Artificial Analysis Intelligence Index
Pricing: Cache Hit, Input, and Output
Context Window
Context Window
Model Size (Open Weights Models Only)
Model Size: Total and Active Parameters
Further details
Weights | |||||||||
|---|---|---|---|---|---|---|---|---|---|
| Llama 3.1 Nemotron Instruct 70B | - | 70B | 128k | - | - | - | - |
Frequently Asked Questions
Common questions about Llama 3.1 Nemotron Instruct 70B
Llama 3.1 Nemotron Instruct 70B was released on October 15, 2024.
Llama 3.1 Nemotron Instruct 70B was created by NVIDIA.
No, Llama 3.1 Nemotron Instruct 70B is not a reasoning model. It provides direct responses without extended chain-of-thought reasoning.
Llama 3.1 Nemotron Instruct 70B supports text input.
Llama 3.1 Nemotron Instruct 70B supports text output.
No, Llama 3.1 Nemotron Instruct 70B does not support image input. It can only process text.
No, Llama 3.1 Nemotron Instruct 70B is not multimodal. It only supports text input.
Llama 3.1 Nemotron Instruct 70B has a context window of 128k tokens. This determines how much text and conversation history the model can process in a single request.
Yes, Llama 3.1 Nemotron Instruct 70B is open weights. The model weights are publicly available and can be downloaded for self-hosting.
Llama 3.1 Nemotron Instruct 70B has 70B parameters.
Llama 3.1 Nemotron Instruct 70B is released under the LLAMA 3.1 COMMUNITY LICENSE AGREEMENT license. Commercial use is allowed with restrictions. View license
Llama 3.1 Nemotron Instruct 70B has a knowledge cutoff of December 2023. The model's training data includes information up to this date.
Llama 3.1 Nemotron Instruct 70B is an open weights model that can be self-hosted. View providers
Llama 3.1 Nemotron Instruct 70B is an open weights model that can be downloaded and self-hosted. Compare providers