Back to models

IBM

Granite 4.0 H Small

  • Released
  • Open weights
  • Apache 2.0
Intelligence Index

Standard setting

6.0
Estimated · Artificial Analysis v4.3.2
Context window
128K tok

Performance profile

ReasoningRank #99 of 107
41.6%
GPQA Diamond

Capabilities

Context window

Modalities

Measured setting

Reasoning trade-offs

Source (opens in a new tab)
Intelligence Index v4.3.2
StandardEstimated
Intelligence Index
6.0

Pricing & access

No API offering listed in our tracked sources.

Run locally

GGUF
Context
Estimated memory

~20.4 GiB

RAM + VRAM

Estimate assumptions

One text chat at the selected context, with a 16-bit cache and app allowance. Operating system and image processing are extra; optimized caches can use less.

32 GiB RAMwithout GPU offload

Memory budgetOne text chat
Weights
18.1 GiB
Context + state
0.3 GiB16-bit cache
App allowance
2 GiB
Download
19.5 GB
Disk space
~27 GB
Get GGUF (opens in a new tab)
Set up in Ollama · Q4_K_M · 8K context

Save the following as Modelfile. The context matches the estimate above.

FROM hf.co/lmstudio-community/granite-4.0-h-small-GGUF:Q4_K_M
PARAMETER num_ctx 8192

Then run these commands in your terminal:

ollama create llmcurrent-local -f Modelfile
ollama run llmcurrent-local

Ollama import instructions (opens in a new tab) · For LM Studio or Jan, open the app’s model search, enter lmstudio-community/granite-4.0-h-small-GGUF, choose Q4_K_M, and set context to 8,192 tokens in the app’s model settings. Software links above open each app’s setup guide.

Benchmarks

Full leaderboardSource (opens in a new tab)

Humanity’s Last Exam

Frontier reasoning

Granite 4.0 H Small · Standard#123 of 126

  1. 1Claude Opus 5.5Max61.4%
  2. 2Claude Fable 5.1Max59.1%
  3. 3Gemini 4 ArgonHigh57.1%
  4. 120Ministral 3 8BStandard4.3%
  5. 121Nova PremierStandard4.2%
  6. 122Command AStandard4.0%
  7. 123Granite 4.0 H SmallStandard3.8%
  8. 124Llama 4 ScoutStandard3.8%
  9. 125Phi-4Standard3.8%
  10. 126Llama 3.3 Instruct 70BStandard3.6%

Peers use their best measured result on this benchmark.