Back to models

NVIDIA

Llama 3.1 Nemotron Instruct 70B

  • Released
  • Open weights
  • Llama 3.1 Community License Agreement
Intelligence Index

Standard setting

6.9
Estimated · Artificial Analysis v4.3.2
Context window
128K tok

Performance profile

ReasoningArchived source
46.5%
GPQA Diamond

Capabilities

Context window

Modalities

Measured setting

Reasoning trade-offs

Source (opens in a new tab)
Intelligence Index v4.3.2
StandardEstimated
Intelligence Index
6.9

Pricing & access

No API offering listed in our tracked sources.

Run locally

GGUF
Context
Estimated memory

~46.1 GiB

RAM + VRAM

Estimate assumptions

One text chat at the selected context, with a 16-bit cache and app allowance. Operating system and image processing are extra; optimized caches can use less.

64 GiB RAMwithout GPU offload

Memory budgetOne text chat
Weights
39.6 GiB
Context cache
2.5 GiB16-bit cache
App allowance
4 GiB
Download
42.5 GB
Disk space
~52 GB
Get GGUF (opens in a new tab)
Set up in Ollama · Q4_K_M · 8K context

Save the following as Modelfile. The context matches the estimate above.

FROM hf.co/lmstudio-community/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF:Q4_K_M
PARAMETER num_ctx 8192

Then run these commands in your terminal:

ollama create llmcurrent-local -f Modelfile
ollama run llmcurrent-local

Ollama import instructions (opens in a new tab) · For LM Studio or Jan, open the app’s model search, enter lmstudio-community/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF, choose Q4_K_M, and set context to 8,192 tokens in the app’s model settings. Software links above open each app’s setup guide.

Benchmarks

Full leaderboardSource (opens in a new tab)

Humanity’s Last Exam

Frontier reasoning

Llama 3.1 Nemotron Instruct 70B · StandardArchived

  1. 1Claude Opus 5.5Max61.4%
  2. 2Claude Fable 5.1Max59.1%
  3. 3Gemini 4 ArgonHigh57.1%
  4. 4Claude Sonnet 5.5Max55.0%
  5. 5GPT-6 AstraMax54.7%
  6. 6Muse Wonder FullMax53.6%
  7. 7GPT-6.1 SolMax52.9%
  8. 8Muse WonderMax50.1%
  9. 9MiMo-V2.6-ProReasoning49.4%
  10. 10Muse Spark 1.3Max48.7%

Peers use their best measured result on this benchmark.