For questions about documents, charts and handwriting, rated highest of the 32 GB Mac picks LM Arena rates.
- Rating
- 4.6
- Downloads
- 749K
- Parameters
- 31B
- Context
- 256K
- Download
- 9.7 to 63 GB
- Commercial use
- Yes
Tight fit on M4 · 16 GB
Outmake picks the UD-IQ2_XXS size: a 9.7 GB download that uses 11 GB of memory, and writes about 5.7 words (7.6 tokens) a second.
About
Google aimed this size of Gemma 4 at maximum quality and as a base for further training. It can take a whole code repository or a long document in one request. Text and pictures can be mixed in any order within the same request.
How it compares
In LM Arena's public vote for reading pictures, it ranks second of 15 open models.
In LM Arena's public vote for coding, it ranks fifth of 59 open models.
Of the 7 chat models Outmake recommends for a 32 GB Mac, Outmake estimates it is the slowest, with Qwen3.6 35B about six times as fast.
Limitations
It can state facts that are wrong or out of date.
Its training data stops in January 2025.
It can miss sarcasm, subtle nuance or figurative language.
Good to know
It was trained on text in more than 140 languages.
Certain personal information was filtered out of its training data before training.
Sources: google/gemma-4-31B-it model card, Gemma 4: Our most capable open models to date, Outmake's speed estimates, LM Arena and Hugging Face. Every line comes from one of these.
Ratings
4.6 out of 5, from how people voted on its answers.
LM Arena ratings of October 28, 2026 (CC BY 4.0): people vote between two answers without knowing which model wrote which. The bar ends at 1488, the best any open model has. The Arena tests the full model; a small size on a Mac answers a little worse.
Good at
Licence
Apache 2.0. Commercial use: yes. The maker's page has the full terms.
Gemma 4 31B runs well from a Mac with an M3 Pro and 18 GB of memory, at UD-IQ2_XXS, writing about 7.2 words (9.5 tokens) a second. 48 of 59 Mac configurations run it well.
Compare with
The nearest models in size, judged for the same Mac.
Sizes
| Size | Download | Memory at 8K | Memory at 32K | Open |
|---|---|---|---|---|
| Q3_K_MSmaller | 16 GB | 18 GB | 19 GB | Open |
| Q4_K_MBalanced | 20 GB | 21 GB | 22 GB | Open |
| Q6_KBest | 26 GB | 28 GB | 29 GB | Open |
All 22 sizes
| Size | Download | Memory at 8K | Memory at 32K | Open |
|---|---|---|---|---|
| UD-IQ2_XXS | 9.7 GB | 11 GBestimated | 12 GB | Open |
| UD-IQ2_M | 12 GB | 14 GBestimated | 15 GB | Open |
| UD-Q2_K_XL | 13 GB | 15 GBestimated | 16 GB | Open |
| UD-IQ3_XXS | 13 GB | 15 GBestimated | 16 GB | Open |
| Q3_K_S | 14 GB | 16 GBestimated | 17 GB | Open |
| UD-Q3_K_XL | 17 GB | 18 GBestimated | 19 GB | Open |
| IQ4_XS | 18 GB | 19 GBestimated | 20 GB | Open |
| IQ4_NL | 18 GB | 20 GBestimated | 21 GB | Open |
| Q4_0 | 19 GB | 20 GBestimated | 21 GB | Open |
| Q4_K_S | 19 GB | 20 GBestimated | 21 GB | Open |
| UD-Q4_K_XL | 20 GB | 22 GBestimated | 23 GB | Open |
| Q4_1 | 20 GB | 22 GBestimated | 23 GB | Open |
| Q5_K_S | 22 GB | 24 GBestimated | 25 GB | Open |
| Q5_K_M | 23 GB | 24 GBestimated | 26 GB | Open |
| UD-Q5_K_XL | 23 GB | 25 GBestimated | 26 GB | Open |
| UD-Q6_K_XL | 29 GB | 30 GBestimated | 31 GB | Open |
| Q8_0 | 34 GB | 35 GBestimated | 37 GB | Open |
| UD-Q8_K_XL | 36 GB | 38 GBestimated | 39 GB | Open |
| BF16 | 63 GB | 64 GBestimated | 65 GB | Open |
Memory is what llama.cpp's own calculator reported for each size when the catalog was built, with the app's settings. Smaller, Balanced and Best are the three sizes the store names.
Run It Anywhere
Gemma 4 31B is an open model, so any app that runs GGUF files can run it. These take the Q4_K_M size from unsloth straight from Hugging Face.
- LM StudioMac, Windows, Linux
Open - JanMac, Windows, Linux
Open - MstyMac, Windows, Linux
Open - OllamaMac, Windows, Linux
ollama run hf.co/unsloth/gemma-4-31B-it-GGUF:Q4_K_M - llama.cppMac, Windows, Linux
llama-server -hf unsloth/gemma-4-31B-it-GGUF:Q4_K_M - Docker Model RunnerMac, Windows, Linux
docker model run hf.co/unsloth/gemma-4-31B-it-GGUF:Q4_K_M
On a PC Graphics Card
| Video memory | Largest size that fits | Download | Memory at 8K |
|---|---|---|---|
| 6 GB | None worth running | needs 14 GB | |
| 8 GB | None worth running | needs 14 GB | |
| 10 GB | None worth running | needs 14 GB | |
| 11 GB | None worth running | needs 14 GB | |
| 12 GB | None worth running | needs 14 GB | |
| 16 GB | UD-IQ3_XXS | 13 GB | 15 GB |
| 20 GB | IQ4_XS | 18 GB | 19 GB |
| 24 GB | Q4_1 | 20 GB | 22 GB |
| 32 GB | UD-Q6_K_XL | 29 GB | 30 GB |
| 48 GB | UD-Q8_K_XL | 36 GB | 38 GB |
The largest size, of those that keep three bits a weight or more, whose memory at an 8K chat is under 92% of the card's; the rest is the desktop's. Estimated from the files, the same way as for a Mac; speed on a PC is not estimated yet. A size that doesn't fit the card still runs, slower, with part of it in ordinary memory.
On every Mac
| Mac | Size | Fit | Memory | Writes | Reads |
|---|---|---|---|---|---|
| M6 · 16 GB | UD-IQ2_XXS | Tight fit | 11 GB | 8.2 | 201 |
| M6 · 24 GB | UD-IQ3_XXS | Runs well | 16 GB | 6.4 | 201 |
| M6 · 32 GB | Q4_K_M | Runs well | 21 GB | 4.5 | 201 |
| M5 · 16 GB | UD-IQ2_XXS | Tight fit | 11 GB | 7.5 | 74 |
| M5 · 24 GB | UD-IQ3_XXS | Runs well | 16 GB | 5.8 | 74 |
| M5 · 32 GB | Q4_K_M | Runs well | 21 GB | 4.1 | 74 |
| M5 Pro · 24 GB | UD-IQ3_XXS | Runs well | 16 GB | 11 | 148 |
| M5 Pro · 48 GB | Q4_K_M | Runs great | 22 GB | 8 | 148 |
| M5 Pro · 64 GB | Q6_K | Runs great | 29 GB | 6.4 | 185 |
| M5 Max · 36 GB | Q4_K_M | Runs well | 22 GB | 12 | 297 |
| M5 Max · 48 GB | Q4_K_M | Runs great | 22 GB | 16 | 371 |
| M5 Max · 64 GB | Q6_K | Runs great | 29 GB | 13 | 371 |
| M5 Max · 128 GB | Q6_K | Runs great | 34 GB | 13 | 371 |
| M5 Ultra · 96 GB | Q6_K | Runs great | 34 GB | 24 | 593 |
| M5 Ultra · 256 GB | Q6_K | Runs great | 34 GB | 24 | 742 |
| M5 Ultra · 512 GB | Q6_K | Runs great | 34 GB | 24 | 742 |
| M4 · 16 GB | UD-IQ2_XXS | Tight fit | 11 GB | 5.7 | 25 |
| M4 · 24 GB | UD-IQ3_XXS | Runs well | 16 GB | 4.5 | 25 |
| M4 · 32 GB | Q4_K_M | Runs well | 21 GB | 3.2 | 25 |
| M4 Pro · 24 GB | UD-IQ3_XXS | Runs well | 16 GB | 9.5 | 50 |
| M4 Pro · 48 GB | Q4_K_M | Runs great | 22 GB | 6.9 | 50 |
| M4 Pro · 64 GB | Q6_K | Runs great | 29 GB | 5.4 | 50 |
| M4 Max · 36 GB | Q4_K_M | Runs well | 22 GB | 9.9 | 100 |
| M4 Max · 48 GB | Q4_K_M | Runs great | 22 GB | 13 | 125 |
| M4 Max · 64 GB | Q6_K | Runs great | 29 GB | 10 | 125 |
| M4 Max · 96 GB | Q6_K | Runs great | 34 GB | 7.7 | 100 |
| M4 Max · 128 GB | Q6_K | Runs great | 34 GB | 10 | 125 |
| M3 · 8 GB | Q3_K_M | Too big | 24 GB | ||
| M3 · 16 GB | UD-IQ2_XXS | Tight fit | 11 GB | 4.9 | 21 |
| M3 · 24 GB | UD-IQ3_XXS | Runs well | 16 GB | 3.9 | 21 |
| M3 Pro · 18 GB | UD-IQ2_XXS | Runs well | 11 GB | 7.2 | 36 |
| M3 Pro · 36 GB | Q4_K_M | Runs well | 22 GB | 4 | 36 |
| M3 Max · 36 GB | Q4_K_M | Runs well | 22 GB | 7.6 | 77 |
| M3 Max · 48 GB | Q4_K_M | Runs great | 22 GB | 9.9 | 103 |
| M3 Max · 64 GB | Q6_K | Runs great | 29 GB | 7.7 | 103 |
| M3 Max · 96 GB | Q6_K | Runs great | 34 GB | 5.9 | 77 |
| M3 Max · 128 GB | Q6_K | Runs great | 34 GB | 7.7 | 103 |
| M3 Ultra · 96 GB | Q6_K | Runs great | 34 GB | 14 | 155 |
| M3 Ultra · 256 GB | Q6_K | Runs great | 34 GB | 14 | 155 |
| M3 Ultra · 512 GB | Q6_K | Runs great | 34 GB | 14 | 206 |
| M2 · 8 GB | Q3_K_M | Too big | 24 GB | ||
| M2 · 16 GB | UD-IQ2_XXS | Tight fit | 11 GB | 4.9 | 20 |
| M2 · 24 GB | UD-IQ3_XXS | Runs well | 16 GB | 3.9 | 20 |
| M2 Pro · 16 GB | UD-IQ2_XXS | Tight fit | 11 GB | 9.3 | 41 |
| M2 Pro · 32 GB | Q4_K_M | Runs well | 21 GB | 5.2 | 41 |
| M2 Max · 32 GB | Q4_K_M | Runs well | 21 GB | 9.9 | 76 |
| M2 Max · 64 GB | Q6_K | Runs great | 29 GB | 7.7 | 76 |
| M2 Max · 96 GB | Q6_K | Runs great | 34 GB | 7.7 | 96 |
| M2 Ultra · 64 GB | Q6_K | Runs great | 29 GB | 14 | 152 |
| M2 Ultra · 128 GB | Q6_K | Runs great | 34 GB | 14 | 152 |
| M2 Ultra · 192 GB | Q6_K | Runs great | 34 GB | 14 | 152 |
| M1 · 8 GB | Q3_K_M | Too big | 24 GB | ||
| M1 · 16 GB | UD-IQ2_XXS | Tight fit | 11 GB | 3.3 | 16 |
| M1 Pro · 16 GB | UD-IQ2_XXS | Tight fit | 11 GB | 8.6 | 33 |
| M1 Pro · 32 GB | Q4_K_M | Runs well | 21 GB | 5 | 33 |
| M1 Max · 32 GB | Q4_K_M | Runs well | 21 GB | 9.1 | 56 |
| M1 Max · 64 GB | Q6_K | Runs great | 29 GB | 7.2 | 56 |
| M1 Ultra · 64 GB | Q6_K | Runs great | 29 GB | 13 | 113 |
| M1 Ultra · 128 GB | Q6_K | Runs great | 34 GB | 13 | 113 |
Writes and reads are words a second (a token is about three quarters of a word), 4K tokens into a chat, estimated unless marked measured. The size is the one the store offers that Mac. Constants fitted October 11, 2026; how, and how wrong.
Badge for the model card
Shows on Gemma 4 31B's Hugging Face card which Macs run it well, linked to this page. It updates every morning.
Sizes and files are read from unsloth/gemma-4-31B-it-GGUF on Hugging Face and checked every morning. The rating is the model's score on the LM Arena text leaderboard (CC BY 4.0), where people vote between two answers without knowing which model wrote which. Catalog of November 4, 2026.
