Outmake Beta Download Beta
Graphics cards

AI models on a 10 GB graphics card

Open chat models judged for a PC card with 10 GB of video memory: which fit with every part on the card, the size to download, and what each one takes.

2798 of the 3940 chat models people download as GGUF fit a 10 GB card whole. The best-rated is Gemma 3 12B at Q4_1, which takes 8.5 GB. The largest rated model that fits is Phi 4 (15B).

Cards with 10 GB: GeForce RTX 3080, Arc B570. The same answer holds for any card with 10 GB of its own memory.

The best-rated models that fit

The 23 with the highest LM Arena rating (data, CC BY 4.0) that fit at 4 bits a weight or more, each at the most bits that fits. Below 4 bits a model's rating overstates it. Each model's page hands it to LM Studio, Jan, Ollama and llama.cpp.

ModelSizeFitTakesLongest chatArenaArena coding
Gemma 3 12BGoogle · 12BQ4_17.6 GB · unslothFits with room8.5 GB16K13421316
Gemma 3n E4BGoogle · 6.9BQ8_07.4 GB · unslothFits with room7.7 GB32K13181307
Granite 4.1 8BIBM · 8.8BQ6_K7.2 GB · ibm-graniteFits with room8.1 GB8K13041353
Gemma 3 4BGoogle · 3.9BQ6_K_L3.4 GB · bartowskiFits with room5.1 GB128K13031273
Granite 4.2 8BIBM · 8.8BQ6_K7.2 GB · ibm-graniteFits with room8.1 GB8K12901370
Granite 4.2 3BIBM · 3.7BQ8_03.9 GB · ibm-graniteFits with room7.1 GB64K12901378
Gemma 2 9BGoogle · 9.2BQ5_K_M6.6 GB · bartowskiFits with room8.4 GB8K12671270
Phi 4Microsoft · 15BQ3_K7.4 GB · microsoftFits with room8.4 GB8K12561306
Aya Expanse 8BCohere · 8BQ6_K_L6.9 GB · bartowskiFits with room7.6 GB8K12231255
Llama 3.1 Tulu 3 8BAi2 · 8BQ6_K6.6 GB · lmstudio-communityFits with room7.9 GB16K1221
Llama 3.1 8BMeta · 8BUD-Q6_K_XL7.3 GB · unslothFits with room8.1 GB8K12111259
Granite 3.1 8BIBM · 8.2BQ6_K_L6.8 GB · bartowskiFits with room8.4 GB16K1209
Gemma 2 2BGoogle · 2.6BQ8_02.8 GB · bartowskiFits with room3.3 GB8K12001191
Phi 3 Medium 4KMicrosoft · 14BQ4_K_S8 GB · bartowskiFits with room8.5 GB4K11981231
Granite 3.1 2BIBM · 2.5BQ8_02.7 GB · bartowskiFits with room5.9 GB64K11791249
Llama 3.2 3BMeta · 3.2BQ8_03.4 GB · unslothFits with room7.9 GB64K11671176
SOLAR 10.7B V1.0Upstage · 11BQ5_K_M7.6 GB · TheBlokeFits with room8.2 GB4K1152
Mistral 7B V0.2Mistral AI · 7.2BQ8_07.7 GB · TheBlokeFits with room8.4 GB8K11491186
Phi 3 Mini 128KMicrosoft · 3.8BQ8_04.1 GB · QuantFactoryFits with room7.9 GB16K11301155
Phi 3 Mini 4KMicrosoft · 3.8BQ8_04.1 GB · bartowskiFits with room5.1 GB4K11281187
SmolLM2 1.7BHugging Face · 1.7BQ8_01.8 GB · bartowskiFits with room2.9 GB8K1115
Llama 3.2 1BMeta · 1.2BQ8_01.3 GB · unslothFits with room3.9 GB128K11111149
Chatglm3 6BZ.ai · 6.2BQ8_06.6 GB · mradermacherFits with room6.9 GB8K10571090

The chat models Outmake picks

12 of these 28 fit. Their memory is what llama.cpp's own calculator reported for each size, not an estimate.

ModelSizeFitTakes
K2-Horizon 7BInstitute of Foundation Models · 9BQ6_K7.8 GBFits with room8.2 GB
K2-Horizon 3.7BInstitute of Foundation Models · 5.1BQ6_K4.4 GBFits with room7.0 GB
Gemma 4 12BGoogle · 12BQ4_K_M7.3 GBFits with room8.4 GB
Qwen3.5 9BAlibaba Qwen · 9BQ6_K8.4 GBFits with room8.4 GB
Gemma 4 E4BGoogle · 8BUD-Q5_K_XL7.6 GBFits with room7.6 GB
Gemma 4 E2BGoogle · 5.1BQ6_K5.5 GBFits with room5.5 GB
Qwen3.5 4BAlibaba Qwen · 4BQ6_K4.2 GBFits with room7.3 GB
Qwen3.5 2BAlibaba Qwen · 2BQ6_K2.2 GBFits with room3.6 GB
Qwen3.5 0.8BAlibaba Qwen · 0.8BQ6_K0.8 GBFits with room2.4 GB
Qwen3.8 27BAlibaba Qwen · 28BUD-IQ2_S9.3 GBFits9.4 GB
GLM 4.7 FlashZ.ai · 31B, 3B activeUD-IQ1_S9.2 GBFits9.6 GB
Devstral Small 2 24BMistral AI · 24BUD-IQ2_M9.1 GBFits9.8 GB
GPT-OSS 20BOpenAI · 21B, 3.6B activeQ3_K_M12 GBBigger than the card13 GB
Gemma 4 26BGoogle · 26B, 3.8B activeUD-Q3_K_M14 GBBigger than the card16 GB
Gemma 4 31BGoogle · 31BQ3_K_M16 GBBigger than the card24 GB
K2-Horizon 36BInstitute of Foundation Models · 37B, 4B activeQ3_K_M17 GBBigger than the card46 GB
Qwen3.6 35BAlibaba Qwen · 36B, 3B activeUD-IQ4_XS19 GBBigger than the card20 GB
Qwen3.5 122BAlibaba Qwen · 122B, 10B activeUD-Q3_K_XL58 GBBigger than the card62 GB
GPT-OSS 120BOpenAI · 117B, 5.1B activeUD-Q4_K_XL63 GBBigger than the card65 GB
Qwen3.8 Flash NextAlibaba Qwen · 177B, 6B activeUD-Q3_K_XL91 GBBigger than the card91 GB
MiniMax M2.7MiniMax · 229B, 10B activeUD-Q3_K_XL102 GBBigger than the card120 GB
Qwen3.5 397BAlibaba Qwen · 403B, 17B activeUD-IQ2_M124 GBBigger than the card129 GB
DeepSeek V4 FlashDeepSeek · 284B, 13B activeUD-Q3_K_XL128 GBBigger than the card129 GB
GLM 5.3Z.AI · 754B, 40B activeUD-Q2_K_XL254 GBBigger than the card265 GB
Kimi K2.6Moonshot AI · 1T, 32B activeUD-Q2_K_XL341 GBBigger than the card351 GB
Kimi K3Moonshot AI · 2.8T, 104B activeUD-IQ2_XXS712 GBBigger than the card716 GB
Qwen3.8 2.4TAlibaba Qwen · 2.4T, 95B activeUD-IQ2_XS731 GBBigger than the card736 GB
DeepSeek V4 ProDeepSeek · 1.6T, 49B activeUD-Q4_K_XL850 GBBigger than the card851 GB

How this is worked out

A model fits when its weights, its memory of the chat so far and the engine's own share come to 9.2 GB or less: 92% of the card, with the rest left for the screen. "Fits with room" is under 80%. "Tight fit" is anything up to half a gigabyte short of the whole card: close other programs that draw with the card first.

"Bigger than the card" does not mean it won't run. llama.cpp and the apps built on it put what doesn't fit in ordinary memory and the model answers slower, often several times slower. So this page lists what fits whole.

There are no speeds here. Outmake's speed estimates are fitted to measurements on Apple chips, and no PC has been measured yet, so a number would be a guess. Memory was checked against the catalog of November 4, 2026; which cards have 10 GB against each maker's specification page on October 13, 2026.

Other sizes