Compare · Models
Qwen2.5-Coder 32B vs Qwen3-Coder 30B-A3B: which runs better locally?
Qwen2.5-Coder 32B needs about 23.3 GB at Q4 with 8K context and fits fully on 1 of 40 GPUs. Qwen3-Coder 30B-A3B needs 20.6 GB and fits on 4. On cards that run both, Qwen3-Coder 30B-A3B is about 3.4x faster because it is a mixture-of-experts model.
Qwen2.5-Coder 32B needs about 23.3 GB at Q4 with 8K context and fits fully on 1 of 40 GPUs. Qwen3-Coder 30B-A3B needs 20.6 GB and fits on 4. On cards that run both, Qwen3-Coder 30B-A3B is about 3.4x faster because it is a mixture-of-experts model.
Each GPU at 8K context with the best quantization that fits. Offload assumes 32 GB of system RAM. Green marks the better result. Rows where the two differ come first.
| GPU | Qwen2.5-Coder 32B | Qwen3-Coder 30B-A3B |
|---|---|---|
| RTX 4090 24 GB | Offload~4.8 tok/sQ4_K_M | Runs~130 tok/sQ4_K_M |
| RX 7900 XTX 24 GB | Offload~4.6 tok/sQ4_K_M | Runs~130 tok/sQ4_K_M |
| RTX 3090 / 3090 Ti 24 GB | Offload~4.5 tok/sQ4_K_M | Runs~120 tok/sQ4_K_M |
| RTX 5090 32 GB | Runs~50 tok/sQ5_K_M | Runs~170 tok/sQ6_K |
| RX 7900 XT 20 GB | Offload~3.5 tok/sQ4_K_M | Offload~15 tok/sQ4_K_M |
| RTX 5080 16 GB | Offload~3.7 tok/sQ4_K_M | Offload~17 tok/sQ4_K_M |
| RTX 5070 Ti 16 GB | Offload~3.5 tok/sQ4_K_M | Offload~16 tok/sQ4_K_M |
| RTX 4080 / 4080 Super 16 GB | Offload~3.0 tok/sQ4_K_M | Offload~14 tok/sQ4_K_M |
| RTX 4070 Ti Super 16 GB | Offload~2.8 tok/sQ4_K_M | Offload~13 tok/sQ4_K_M |
| RX 9070 XT 16 GB | Offload~2.7 tok/sQ4_K_M | Offload~13 tok/sQ4_K_M |
| RX 7800 XT 16 GB | Offload~2.6 tok/sQ4_K_M | Offload~13 tok/sQ4_K_M |
| Arc A770 16 GB | Offload~2.4 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RX 6800 XT 16 GB | Offload~2.3 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 5060 Ti 16 GB | Offload~2.1 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 4060 Ti 16 GB | Offload~1.6 tok/sQ4_K_M | Offload~7.9 tok/sQ4_K_M |
| RTX 5070 12 GB | Offload~2.5 tok/sQ4_K_M | Offload~13 tok/sQ4_K_M |
| RTX 4070 / 4070 Super 12 GB | Offload~2.1 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| Arc B580 12 GB | Offload~2.0 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RX 7700 XT 12 GB | Offload~2.0 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RX 6700 XT 12 GB | Offload~1.9 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 3060 12 GB | Offload~1.8 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| GTX 1080 Ti 11 GB | Offload~2.1 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 3080 10 GB | Offload~2.6 tok/sQ4_K_M | Offload~14 tok/sQ4_K_M |
| Arc A750 8 GB | Offload~2.0 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 5060 Ti 8 GB | Offload~1.9 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 5060 8 GB | Offload~1.9 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 3070 / 3070 Ti 8 GB | Offload~1.9 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 3060 Ti 8 GB | Offload~1.9 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 4060 Ti 8 GB | Offload~1.7 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RX 7600 8 GB | Offload~1.7 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 4060 8 GB | Offload~1.7 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 3050 8 GB | Offload~1.6 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| GTX 1660 / 1660 Super 6 GB | Offload~1.8 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| GTX 1650 4 GB | Offload~2.0 tok/sQ3_K_M | Offload~11 tok/sQ4_K_M |
| RTX 4090 Laptop 16 GB | Offload~2.5 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 4080 Laptop 12 GB | Offload~2.0 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 4070 Laptop 8 GB | Offload~1.6 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 4060 Laptop 8 GB | Offload~1.6 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 3060 Laptop 6 GB | Offload~1.8 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 4050 Laptop 6 GB | Offload~1.6 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
Which should you run?
Qwen3-Coder 30B-A3B runs faster at a similar size. Qwen2.5-Coder 32B needs about 23.3 GB at Q4 with 8K context and fits fully on 1 of 40 GPUs. Qwen3-Coder 30B-A3B needs 20.6 GB and fits on 4. On cards that run both, Qwen3-Coder 30B-A3B is about 3.4x faster because it is a mixture-of-experts model.
Only Qwen3-Coder 30B-A3B fits on RTX 4090, RTX 3090 / 3090 Ti and RX 7900 XTX.
See every result on its own page: Qwen2.5-Coder 32B and Qwen3-Coder 30B-A3B.
Questions
Is Qwen2.5-Coder 32B or Qwen3-Coder 30B-A3B better?
Qwen3-Coder 30B-A3B runs faster at a similar size. Qwen2.5-Coder 32B needs about 23.3 GB at Q4 with 8K context and fits fully on 1 of 40 GPUs. Qwen3-Coder 30B-A3B needs 20.6 GB and fits on 4. On cards that run both, Qwen3-Coder 30B-A3B is about 3.4x faster because it is a mixture-of-experts model. The right pick depends on what you use it for: compare the strengths listed on each model's page.
Which needs less VRAM, Qwen2.5-Coder 32B or Qwen3-Coder 30B-A3B?
Qwen2.5-Coder 32B needs about 23 GB at Q4 with 8K context, Qwen3-Coder 30B-A3B about 21 GB. At Q8 it is 40 GB versus 36 GB.
Can I run Qwen2.5-Coder 32B and Qwen3-Coder 30B-A3B on a 12 GB GPU?
On an RTX 3060 12 GB, Qwen2.5-Coder 32B only runs with part of the model in system RAM, at a few tokens per second and Qwen3-Coder 30B-A3B only runs with part of the model in system RAM, at a few tokens per second.
More comparisons
Estimates from memory size and bandwidth at 8K context. Real speed varies with software, drivers and settings.