What LLMs can the Radeon RX 9070 XT (16 GB) run?
GPUData updated . Last reviewed the same day, when this catalog snapshot was written.
AMD cards run local models through ROCm or Vulkan. Tooling is less turnkey than CUDA. Usable VRAM is 95% of the sticker figure.
- VRAM
- 16.0 GB
- Usable
- 15.2 GB
- Bandwidth
- 640 GB/s
- List price
- $599
- Year
- 2025
- Q4 models
- 21/49
AMD launch SEP, March 2025. AMD later revised the list price.
Amazon links are affiliate searches, not live prices.
Models
Sorted with Q4 fits first. Memory figures already include the 20% overhead.
| Model | Params | Q4 | Q8 | FP16 |
|---|---|---|---|---|
| Llama 3.2 1B Instruct Llama | 1.24B | Fits0.8 GB | Fits1.3 GB | Fits3.0 GB |
| Llama 3.2 3B Instruct Llama | 3.21B | Fits2.0 GB | Fits3.4 GB | Fits7.7 GB |
| Phi-3.5 mini Phi | 3.82B | Fits5.6 GB | Fits7.3 GB | Fits9.2 GB |
| Phi-4 mini Phi | 3.84B | Fits3.6 GB | Fits5.2 GB | Fits9.2 GB |
| Gemma 3 4B Gemma | 4.3B | Fits2.5 GB | Fits4.1 GB | Fits10.3 GB |
| Mistral 7B Instruct v0.3 Mistral | 7.25B | Fits5.4 GB | Fits8.8 GB | No17.4 GB |
| Qwen2.5 7B Instruct Qwen | 7.62B | Fits5.2 GB | Fits8.6 GB | No18.3 GB |
| Gemma 4 E4B Gemma | 8B | Fits5.1 GB | Fits8.3 GB | No19.2 GB |
| DeepSeek R1 Distill Llama 8B DeepSeek | 8.03B | Fits6.0 GB | Fits9.6 GB | No19.3 GB |
| Llama 3.1 8B Instruct Llama | 8.03B | Fits4.9 GB | Fits9.6 GB | No19.3 GB |
| Qwen3 8B Qwen | 8.19B | Fits6.2 GB | Fits9.9 GB | No19.7 GB |
| Ministral 3 8B Mistral | 8.92B | Fits6.3 GB | Fits10.2 GB | No21.4 GB |
| Gemma 2 9B Gemma | 9.24B | Fits6.8 GB | Fits10.7 GB | No22.2 GB |
| Gemma 4 12B Gemma | 12B | Fits7.7 GB | Tight13.2 GB | No28.7 GB |
| Gemma 3 12B Gemma | 12.2B | Fits7.3 GB | Fits12.5 GB | No29.2 GB |
| Mistral Nemo 12B Mistral | 12.2B | Fits8.8 GB | Tight14.4 GB | No29.4 GB |
| Ministral 3 14B Mistral | 13.9B | Fits9.6 GB | No15.7 GB | No33.5 GB |
| Phi-4 Phi | 14.7B | Fits10.6 GB | No17.3 GB | No35.2 GB |
| Qwen3 14B Qwen | 14.8B | Fits10.3 GB | No17.0 GB | No35.4 GB |
| Qwen2.5 14B Instruct Qwen | 14.8B | Fits10.6 GB | No17.3 GB | No35.4 GB |
| gpt-oss-20b gpt-oss | 20.9B 3.6B active | Fits11.8 GB | Fits12.3 GB | No50.2 GB |
| Mistral Small 3.2 24B Mistral | 24B | No15.7 GB | No26.4 GB | No57.6 GB |
| Gemma 4 26B-A4B Gemma | 25.8B 3.8B active | No17.3 GB | No27.2 GB | No61.9 GB |
| Gemma 2 27B Gemma | 27.2B | No16.6 GB | No30.0 GB | No65.3 GB |
| Gemma 3 27B Gemma | 27.4B | No16.5 GB | No28.7 GB | No65.8 GB |
| Qwen3.6 27B Qwen | 27.8B | No17.4 GB | No29.1 GB | No66.7 GB |
| Qwen3.8 27B Qwen | 27.8B | No17.0 GB | No29.6 GB | No66.7 GB |
| Qwen3 30B-A3B Qwen | 30.5B 3B active | No19.4 GB | No33.3 GB | No73.3 GB |
| GLM-4.7-Flash GLM | 31.2B 3B active | No18.8 GB | No32.3 GB | No74.9 GB |
| Gemma 4 31B Gemma | 31.3B | No19.7 GB | No34.0 GB | No75.1 GB |
| Qwen3 32B Qwen | 32.8B | No21.9 GB | No37.0 GB | No78.6 GB |
| DeepSeek R1 Distill Qwen 32B DeepSeek | 32.8B | No22.0 GB | No37.0 GB | No78.6 GB |
| Qwen2.5 32B Instruct Qwen | 32.8B | No22.0 GB | No37.0 GB | No78.6 GB |
| Qwen3.6 35B-A3B Qwen | 36B 3B active | No22.3 GB | No37.1 GB | No86.3 GB |
| Mixtral 8x7B Mistral | 46.7B 12.9B active | No27.5 GB | No50.7 GB | No112 GB |
| DeepSeek R1 Distill Llama 70B DeepSeek | 70.6B | No45.2 GB | No77.7 GB | No169 GB |
| Llama 3.3 70B Instruct Llama | 70.6B | No42.5 GB | No75.0 GB | No169 GB |
| Qwen2.5 72B Instruct Qwen | 72.7B | No46.7 GB | No80.2 GB | No174 GB |
| Llama 4 Scout Llama | 109B 17B active | No65.4 GB | No115 GB | No261 GB |
| gpt-oss-120b gpt-oss | 117B 5.1B active | No63.1 GB | No63.7 GB | No280 GB |
| Mistral Small 4 Mistral | 119B 6.5B active | No74.0 GB | No127 GB | No287 GB |
| Mixtral 8x22B Mistral | 141B 39B active | No87.5 GB | No151 GB | No338 GB |
| Qwen3 235B-A22B Qwen | 235B 22B active | No144 GB | No252 GB | No564 GB |
| DeepSeek V4 Flash DeepSeek | 291B 13B active | No175 GB | Fits4.5 GB | No698 GB |
| Llama 4 Maverick Llama | 402B 17B active | No243 GB | No426 GB | No964 GB |
| Llama 3.1 405B Instruct Llama | 406B | No244 GB | No487 GB | No974 GB |
| Mistral Large 3 Mistral | 675B 41B active | No407 GB | No716 GB | No1620 GB |
| DeepSeek R1 DeepSeek | 684B 37B active | No405 GB | No714 GB | No1643 GB |
| DeepSeek V4 Pro DeepSeek | 1599B 49B active | No959 GB | No1673 GB | No3837 GB |