Compare · Models
Qwen3.6 35B-A3B (MoE) vs Qwen3 30B-A3B (MoE): which runs better locally?
Qwen3.6 35B-A3B (MoE) needs about 23.5 GB at Q4 with 8K context and fits fully on 1 of 40 GPUs. Qwen3 30B-A3B (MoE) needs 20.6 GB and fits on 4. On cards that run both, Qwen3.6 35B-A3B (MoE) is about 19% faster.
Qwen3.6 35B-A3B (MoE) needs about 23.5 GB at Q4 with 8K context and fits fully on 1 of 40 GPUs. Qwen3 30B-A3B (MoE) needs 20.6 GB and fits on 4. On cards that run both, Qwen3.6 35B-A3B (MoE) is about 19% faster.
Each GPU at 8K context with the best quantization that fits. Offload assumes 32 GB of system RAM. Green marks the better result. Rows where the two differ come first.
| GPU | Qwen3.6 35B-A3B (MoE) | Qwen3 30B-A3B (MoE) |
|---|---|---|
| RTX 4090 24 GB | Offload~20 tok/sQ4_K_M | Runs~130 tok/sQ4_K_M |
| RX 7900 XTX 24 GB | Offload~19 tok/sQ4_K_M | Runs~130 tok/sQ4_K_M |
| RTX 3090 / 3090 Ti 24 GB | Offload~19 tok/sQ4_K_M | Runs~120 tok/sQ4_K_M |
| RTX 5090 32 GB | Runs~200 tok/sQ5_K_M | Runs~170 tok/sQ6_K |
| RX 7900 XT 20 GB | Offload~16 tok/sQ4_K_M | Offload~15 tok/sQ4_K_M |
| RTX 5080 16 GB | Offload~17 tok/sQ4_K_M | Offload~17 tok/sQ4_K_M |
| RTX 5070 Ti 16 GB | Offload~16 tok/sQ4_K_M | Offload~16 tok/sQ4_K_M |
| RTX 4080 / 4080 Super 16 GB | Offload~14 tok/sQ4_K_M | Offload~14 tok/sQ4_K_M |
| RTX 4070 Ti Super 16 GB | Offload~14 tok/sQ4_K_M | Offload~13 tok/sQ4_K_M |
| RX 9070 XT 16 GB | Offload~13 tok/sQ4_K_M | Offload~13 tok/sQ4_K_M |
| RX 7800 XT 16 GB | Offload~13 tok/sQ4_K_M | Offload~13 tok/sQ4_K_M |
| Arc A770 16 GB | Offload~12 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RX 6800 XT 16 GB | Offload~12 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 5060 Ti 16 GB | Offload~11 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 4060 Ti 16 GB | Offload~8.8 tok/sQ4_K_M | Offload~7.9 tok/sQ4_K_M |
| RTX 5070 12 GB | Offload~14 tok/sQ4_K_M | Offload~13 tok/sQ4_K_M |
| RTX 4070 / 4070 Super 12 GB | Offload~12 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| Arc B580 12 GB | Offload~12 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RX 7700 XT 12 GB | Offload~11 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RX 6700 XT 12 GB | Offload~11 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 3060 12 GB | Offload~11 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| GTX 1080 Ti 11 GB | Offload~12 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 3080 10 GB | Offload~14 tok/sQ4_K_M | Offload~14 tok/sQ4_K_M |
| Arc A750 8 GB | Offload~13 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 5060 Ti 8 GB | Offload~12 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 5060 8 GB | Offload~12 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 3070 / 3070 Ti 8 GB | Offload~12 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 3060 Ti 8 GB | Offload~12 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 4060 Ti 8 GB | Offload~11 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RX 7600 8 GB | Offload~11 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 4060 8 GB | Offload~11 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 3050 8 GB | Offload~11 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| GTX 1660 / 1660 Super 6 GB | Offload~12 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| GTX 1650 4 GB | Offload~14 tok/sQ3_K_M | Offload~11 tok/sQ4_K_M |
| RTX 4090 Laptop 16 GB | Offload~12 tok/sQ4_K_M | Offload~12 tok/sQ4_K_M |
| RTX 4080 Laptop 12 GB | Offload~11 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 4070 Laptop 8 GB | Offload~11 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 4060 Laptop 8 GB | Offload~11 tok/sQ4_K_M | Offload~10 tok/sQ4_K_M |
| RTX 3060 Laptop 6 GB | Offload~12 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
| RTX 4050 Laptop 6 GB | Offload~11 tok/sQ4_K_M | Offload~11 tok/sQ4_K_M |
Which should you run?
Qwen3.6 35B-A3B (MoE) runs faster at a similar size. Qwen3.6 35B-A3B (MoE) needs about 23.5 GB at Q4 with 8K context and fits fully on 1 of 40 GPUs. Qwen3 30B-A3B (MoE) needs 20.6 GB and fits on 4. On cards that run both, Qwen3.6 35B-A3B (MoE) is about 19% faster.
Only Qwen3 30B-A3B (MoE) fits on RTX 4090, RTX 3090 / 3090 Ti and RX 7900 XTX.
See every result on its own page: Qwen3.6 35B-A3B (MoE) and Qwen3 30B-A3B (MoE).
Questions
Is Qwen3.6 35B-A3B (MoE) or Qwen3 30B-A3B (MoE) better?
Qwen3.6 35B-A3B (MoE) runs faster at a similar size. Qwen3.6 35B-A3B (MoE) needs about 23.5 GB at Q4 with 8K context and fits fully on 1 of 40 GPUs. Qwen3 30B-A3B (MoE) needs 20.6 GB and fits on 4. On cards that run both, Qwen3.6 35B-A3B (MoE) is about 19% faster. The right pick depends on what you use it for: compare the strengths listed on each model's page.
Which needs less VRAM, Qwen3.6 35B-A3B (MoE) or Qwen3 30B-A3B (MoE)?
Qwen3.6 35B-A3B (MoE) needs about 24 GB at Q4 with 8K context, Qwen3 30B-A3B (MoE) about 21 GB. At Q8 it is 42 GB versus 36 GB.
Can I run Qwen3.6 35B-A3B (MoE) and Qwen3 30B-A3B (MoE) on a 12 GB GPU?
On an RTX 3060 12 GB, Qwen3.6 35B-A3B (MoE) only runs with part of the model in system RAM, at a few tokens per second and Qwen3 30B-A3B (MoE) only runs with part of the model in system RAM, at a few tokens per second.
More comparisons
Estimates from memory size and bandwidth at 8K context. Real speed varies with software, drivers and settings.