GPUs
Which local LLMs can your GPU run?
Pick your graphics card to see every popular open model it can run, the quantization to download and the expected speed. 40 desktop and laptop cards from NVIDIA, AMD and Intel.
NVIDIA
RTX 509032 GB · 34 models fit · up to Qwen3.6 35B-A3B (MoE)RTX 409024 GB · 28 models fit · up to Qwen3 30B-A3B (MoE)RTX 3090 / 3090 Ti24 GB · 28 models fit · up to Qwen3 30B-A3B (MoE)RTX 508016 GB · 21 models fit · up to gpt-oss 20BRTX 5070 Ti16 GB · 21 models fit · up to gpt-oss 20BRTX 4080 / 4080 Super16 GB · 21 models fit · up to gpt-oss 20BRTX 4070 Ti Super16 GB · 21 models fit · up to gpt-oss 20BRTX 4090 Laptop16 GB · 21 models fit · up to gpt-oss 20BRTX 5060 Ti16 GB · 21 models fit · up to gpt-oss 20BRTX 4060 Ti16 GB · 21 models fit · up to gpt-oss 20BRTX 507012 GB · 16 models fit · up to Mistral Nemo 12BRTX 4070 / 4070 Super12 GB · 16 models fit · up to Mistral Nemo 12BRTX 4080 Laptop12 GB · 16 models fit · up to Mistral Nemo 12BRTX 306012 GB · 16 models fit · up to Mistral Nemo 12BGTX 1080 Ti11 GB · 15 models fit · up to Mistral Nemo 12BRTX 308010 GB · 14 models fit · up to Qwen3.5 9BRTX 5060 Ti8 GB · 14 models fit · up to Qwen3.5 9BRTX 50608 GB · 14 models fit · up to Qwen3.5 9BRTX 3070 / 3070 Ti8 GB · 14 models fit · up to Qwen3.5 9BRTX 3060 Ti8 GB · 14 models fit · up to Qwen3.5 9BRTX 4060 Ti8 GB · 14 models fit · up to Qwen3.5 9BRTX 40608 GB · 14 models fit · up to Qwen3.5 9BRTX 4070 Laptop8 GB · 14 models fit · up to Qwen3.5 9BRTX 4060 Laptop8 GB · 14 models fit · up to Qwen3.5 9BRTX 30508 GB · 14 models fit · up to Qwen3.5 9BGTX 1660 / 1660 Super6 GB · 8 models fit · up to Qwen3.5 4BRTX 3060 Laptop6 GB · 8 models fit · up to Qwen3.5 4BRTX 4050 Laptop6 GB · 8 models fit · up to Qwen3.5 4BGTX 16504 GB · 5 models fit · up to Phi-4 Mini 3.8B
AMD
RX 7900 XTX24 GB · 28 models fit · up to Qwen3 30B-A3B (MoE)RX 7900 XT20 GB · 24 models fit · up to Mistral Small 3 24BRX 9070 XT16 GB · 21 models fit · up to gpt-oss 20BRX 7800 XT16 GB · 21 models fit · up to gpt-oss 20BRX 6800 XT16 GB · 21 models fit · up to gpt-oss 20BRX 7700 XT12 GB · 16 models fit · up to Mistral Nemo 12BRX 6700 XT12 GB · 16 models fit · up to Mistral Nemo 12BRX 76008 GB · 14 models fit · up to Qwen3.5 9B
Intel
Arc A77016 GB · 21 models fit · up to gpt-oss 20BArc B58012 GB · 16 models fit · up to Mistral Nemo 12BArc A7508 GB · 14 models fit · up to Qwen3.5 9B
Using a Mac? The checker covers every Apple Silicon chip from M1 to M4.