Qwen3 30B-A3B (MoE): VRAM requirements and GPUs that run it

Memory needed by quantization

Totals include about 10% runtime overhead and the KV cache. Longer conversations cost real memory: going from 8K to 32K context adds about 2.3 GB at any quantization. It is a mixture-of-experts model: 30.5B parameters in total but only about 3.3B are used for each token, so it runs much faster than a dense model of the same size and stays usable even when part of it sits in system RAM. Most people should download Q4_K_M; Q5 or Q8 only make sense if you have spare memory. Read which quantization to pick.

Which GPUs can run Qwen3 30B-A3B (MoE)?

4 of the 40 cards we track run it fully in VRAM at 8K context. The cheapest entry point is a 24 GB card such as the RTX 3090 / 3090 Ti, and the fastest is the RTX 5090 at about 170 tokens per second. 36 more can run it with part of the model in system RAM, which is noticeably slower.

Running it on a Mac

Apple Silicon Macs can give a model about 72% of their unified memory. Qwen3 30B-A3B (MoE) fits from 24 GB (Apple M3, about 16 tokens per second). With a faster chip like the Apple M3 Ultra (96 GB) expect around 60 tokens per second. Compare the options in our Mac vs NVIDIA guide.

Similar size models: gpt-oss 20B, Codestral 22B, Mistral Small 3 24B, Devstral Small 24B, Gemma 3 27B.

Compare Qwen3 30B-A3B (MoE)

Questions

Estimates based on model size, architecture and memory bandwidth. Real numbers vary with software, drivers and context length.