GPUs · AMD
Can the RX 7900 XTX run local LLMs?
With 24 GB of VRAM (about 21.6 GB usable) and 960 GB/s of memory bandwidth, the RX 7900 XTX runs 28 of 39 popular open models fully on the GPU at 8K context. The largest is Qwen3 30B-A3B (MoE) at Q4_K_M, at roughly 130 tokens per second.
Best picks for the RX 7900 XTX
Every model on the RX 7900 XTX
Results at 8K context, picking the highest quality quantization that fits. "Offload" means part of the model runs from system RAM (we assume 32 GB), which works but is much slower.
| Model | Status | Quant | Memory | Speed |
|---|---|---|---|---|
| Qwen3 30B-A3B (MoE) | Runs well | Q4_K_M | 21 GB | ~130 tok/s |
| Qwen3-Coder 30B-A3B | Runs well | Q4_K_M | 21 GB | ~130 tok/s |
| Qwen3.6 27B | Runs well | Q4_K_M | 19 GB | ~38 tok/s |
| Gemma 4 26B-A4B (MoE) | Runs well | Q4_K_M | 19 GB | ~110 tok/s |
| Mistral Small 3 24B | Runs well | Q5_K_M | 21 GB | ~37 tok/s |
| Devstral Small 24B | Runs well | Q5_K_M | 20 GB | ~37 tok/s |
| Codestral 22B | Runs well | Q5_K_M | 19 GB | ~40 tok/s |
| gpt-oss 20B | Runs well | Q6_K | 19 GB | ~92 tok/s |
| Qwen3 14B | Runs well | Q8_0 | 19 GB | ~40 tok/s |
| DeepSeek-R1 Distill 14B | Runs well | Q8_0 | 19 GB | ~40 tok/s |
| Phi-4 14B | Runs well | Q8_0 | 18 GB | ~40 tok/s |
| Gemma 3 12B | Runs well | Q8_0 | 17 GB | ~48 tok/s |
| Mistral Nemo 12B | Runs well | Q8_0 | 16 GB | ~48 tok/s |
| Gemma 4 12B | Runs well | Q8_0 | 17 GB | ~49 tok/s |
| Qwen3.5 9B | Runs well | Q8_0 | 12 GB | ~63 tok/s |
| Qwen3 8B | Runs well | Q8_0 | 11 GB | ~72 tok/s |
| Llama 3.1 8B | Runs well | Q8_0 | 10 GB | ~74 tok/s |
| DeepSeek-R1 Distill 8B | Runs well | Q8_0 | 10 GB | ~74 tok/s |
| Qwen2.5-Coder 7B | Runs well | Q8_0 | 9.8 GB | ~77 tok/s |
| Mistral 7B v0.3 | Runs well | Q8_0 | 9.4 GB | ~82 tok/s |
| Qwen3.5 4B | Runs well | Q8_0 | 6.4 GB | ~130 tok/s |
| Gemma 3 4B | Runs well | Q8_0 | 6.9 GB | ~140 tok/s |
| Qwen3 4B | Runs well | Q8_0 | 5.8 GB | ~150 tok/s |
| Phi-4 Mini 3.8B | Runs well | Q8_0 | 5.2 GB | ~150 tok/s |
| Llama 3.2 3B | Runs well | Q8_0 | 4.6 GB | ~180 tok/s |
| Llama 3.2 1B | Runs well | Q8_0 | 1.6 GB | ~490 tok/s |
| Gemma 3 1B | Runs well | Q8_0 | 1.4 GB | ~590 tok/s |
| Qwen3 0.6B | Runs well | Q8_0 | 0.9 GB | ~980 tok/s |
| Gemma 3 27B | Offload | Q4_K_M | 22 GB | ~5.7 tok/s |
| Qwen3 32B | Offload | Q4_K_M | 23 GB | ~4.6 tok/s |
| DeepSeek-R1 Distill 32B | Offload | Q4_K_M | 23 GB | ~4.6 tok/s |
| Qwen2.5-Coder 32B | Offload | Q4_K_M | 23 GB | ~4.6 tok/s |
| Qwen3.6 35B-A3B (MoE) | Offload | Q4_K_M | 23 GB | ~19 tok/s |
| Gemma 4 31B | Offload | Q4_K_M | 25 GB | ~4.7 tok/s |
| Llama 3.3 70B | Offload | Q3_K_M | 40 GB | ~2.0 tok/s |
| DeepSeek-R1 Distill 70B | Offload | Q3_K_M | 40 GB | ~2.0 tok/s |
| Llama 4 Scout 109B-A17B | Won’t fit | — | 73 GB | — |
| gpt-oss 120B | Won’t fit | — | 77 GB | — |
| Qwen3 235B-A22B (MoE) | Won’t fit | — | 155 GB | — |
What this means in practice
The RX 7900 XTX is comfortable with models up to about 30B parameters. Qwen3.6 35B-A3B (MoE) is the most useful step up beyond that: it needs about 23 GB, so part of it runs from system RAM, but as a mixture-of-experts model it stays reasonably quick at around 19 tokens per second. Models from Llama 4 Scout 109B-A17B upward need 73 GB or more and are out of reach. AMD cards work with Ollama and LM Studio through ROCm or Vulkan; setup is smoother on Linux and recent Windows drivers.
The next memory tier up is 32 GB: RTX 5090. Other 24 GB cards: RTX 4090, RTX 3090 / 3090 Ti.
Compare the RX 7900 XTX
Questions
What is the biggest model the RX 7900 XTX can run?
At 8K context the largest model that fits entirely in its 24 GB of VRAM is Qwen3 30B-A3B (MoE) at Q4_K_M, at roughly 130 tokens per second.
Can the RX 7900 XTX run 70B models like Llama 3.3 70B?
Only with heavy CPU offload. It needs about 40 GB at Q4, far more than 24 GB, so speed drops to a few tokens per second. A 48 GB setup or a Mac with 64 GB or more is the practical route.
What is the best model for coding on the RX 7900 XTX?
Qwen3 30B-A3B (MoE) at Q4_K_M fits fully and runs at about 130 tokens per second. Pair it with an editor extension like Continue pointed at Ollama.
Estimates based on memory size and bandwidth; real speed varies with drivers, software and context length. See how we calculate VRAM.