Outmake Models
Models

Gemma 4 31B

Google · March 2026

For questions about documents, charts and handwriting, rated highest of the 32 GB Mac picks LM Arena rates.

Rating
4.6
Downloads
749K
Parameters
31B
Context
256K
Download
9.7 to 63 GB
Commercial use
Yes

Tight fit on M4 · 16 GB

Outmake picks the UD-IQ2_XXS size: a 9.7 GB download that uses 11 GB of memory, and writes about 5.7 words (7.6 tokens) a second.

About

Google aimed this size of Gemma 4 at maximum quality and as a base for further training. It can take a whole code repository or a long document in one request. Text and pictures can be mixed in any order within the same request.

How it compares

In LM Arena's public vote for reading pictures, it ranks second of 15 open models.

In LM Arena's public vote for coding, it ranks fifth of 59 open models.

Of the 7 chat models Outmake recommends for a 32 GB Mac, Outmake estimates it is the slowest, with Qwen3.6 35B about six times as fast.

Limitations

It can state facts that are wrong or out of date.

Its training data stops in January 2025.

It can miss sarcasm, subtle nuance or figurative language.

Good to know

It was trained on text in more than 140 languages.

Certain personal information was filtered out of its training data before training.

Sources: google/gemma-4-31B-it model card, Gemma 4: Our most capable open models to date, Outmake's speed estimates, LM Arena and Hugging Face. Every line comes from one of these.

Ratings

4.6 out of 5, from how people voted on its answers.

Text
1452
Coding
1502
Vision
1273

LM Arena ratings of October 28, 2026 (CC BY 4.0): people vote between two answers without knowing which model wrote which. The bar ends at 1488, the best any open model has. The Arena tests the full model; a small size on a Mac answers a little worse.

Good at

  • Pulling text out of PDFs
  • Reading handwriting and charts
  • Questions about a screenshot
  • Long documents in one request

Licence

Apache 2.0. Commercial use: yes. The maker's page has the full terms.

Gemma 4 31B runs well from a Mac with an M3 Pro and 18 GB of memory, at UD-IQ2_XXS, writing about 7.2 words (9.5 tokens) a second. 48 of 59 Mac configurations run it well.

Compare with

The nearest models in size, judged for the same Mac.

Sizes

SizeDownloadMemory at 8KMemory at 32KOpen
Q3_K_MSmaller16 GB18 GB19 GBOpen
Q4_K_MBalanced20 GB21 GB22 GBOpen
Q6_KBest26 GB28 GB29 GBOpen
All 22 sizes
SizeDownloadMemory at 8KMemory at 32KOpen
UD-IQ2_XXS9.7 GB11 GBestimated12 GBOpen
UD-IQ2_M12 GB14 GBestimated15 GBOpen
UD-Q2_K_XL13 GB15 GBestimated16 GBOpen
UD-IQ3_XXS13 GB15 GBestimated16 GBOpen
Q3_K_S14 GB16 GBestimated17 GBOpen
UD-Q3_K_XL17 GB18 GBestimated19 GBOpen
IQ4_XS18 GB19 GBestimated20 GBOpen
IQ4_NL18 GB20 GBestimated21 GBOpen
Q4_019 GB20 GBestimated21 GBOpen
Q4_K_S19 GB20 GBestimated21 GBOpen
UD-Q4_K_XL20 GB22 GBestimated23 GBOpen
Q4_120 GB22 GBestimated23 GBOpen
Q5_K_S22 GB24 GBestimated25 GBOpen
Q5_K_M23 GB24 GBestimated26 GBOpen
UD-Q5_K_XL23 GB25 GBestimated26 GBOpen
UD-Q6_K_XL29 GB30 GBestimated31 GBOpen
Q8_034 GB35 GBestimated37 GBOpen
UD-Q8_K_XL36 GB38 GBestimated39 GBOpen
BF1663 GB64 GBestimated65 GBOpen

Memory is what llama.cpp's own calculator reported for each size when the catalog was built, with the app's settings. Smaller, Balanced and Best are the three sizes the store names.

Run It Anywhere

Gemma 4 31B is an open model, so any app that runs GGUF files can run it. These take the Q4_K_M size from unsloth straight from Hugging Face.

  • LM StudioMac, Windows, LinuxOpen
  • JanMac, Windows, LinuxOpen
  • MstyMac, Windows, LinuxOpen
  • OllamaMac, Windows, Linuxollama run hf.co/unsloth/gemma-4-31B-it-GGUF:Q4_K_M
  • llama.cppMac, Windows, Linuxllama-server -hf unsloth/gemma-4-31B-it-GGUF:Q4_K_M
  • Docker Model RunnerMac, Windows, Linuxdocker model run hf.co/unsloth/gemma-4-31B-it-GGUF:Q4_K_M
On a PC Graphics Card
Video memoryLargest size that fitsDownloadMemory at 8K
6 GBNone worth runningneeds 14 GB
8 GBNone worth runningneeds 14 GB
10 GBNone worth runningneeds 14 GB
11 GBNone worth runningneeds 14 GB
12 GBNone worth runningneeds 14 GB
16 GBUD-IQ3_XXS13 GB15 GB
20 GBIQ4_XS18 GB19 GB
24 GBQ4_120 GB22 GB
32 GBUD-Q6_K_XL29 GB30 GB
48 GBUD-Q8_K_XL36 GB38 GB

The largest size, of those that keep three bits a weight or more, whose memory at an 8K chat is under 92% of the card's; the rest is the desktop's. Estimated from the files, the same way as for a Mac; speed on a PC is not estimated yet. A size that doesn't fit the card still runs, slower, with part of it in ordinary memory.

On every Mac
MacSizeFitMemoryWritesReads
M6 · 16 GBUD-IQ2_XXSTight fit11 GB8.2201
M6 · 24 GBUD-IQ3_XXSRuns well16 GB6.4201
M6 · 32 GBQ4_K_MRuns well21 GB4.5201
M5 · 16 GBUD-IQ2_XXSTight fit11 GB7.574
M5 · 24 GBUD-IQ3_XXSRuns well16 GB5.874
M5 · 32 GBQ4_K_MRuns well21 GB4.174
M5 Pro · 24 GBUD-IQ3_XXSRuns well16 GB11148
M5 Pro · 48 GBQ4_K_MRuns great22 GB8148
M5 Pro · 64 GBQ6_KRuns great29 GB6.4185
M5 Max · 36 GBQ4_K_MRuns well22 GB12297
M5 Max · 48 GBQ4_K_MRuns great22 GB16371
M5 Max · 64 GBQ6_KRuns great29 GB13371
M5 Max · 128 GBQ6_KRuns great34 GB13371
M5 Ultra · 96 GBQ6_KRuns great34 GB24593
M5 Ultra · 256 GBQ6_KRuns great34 GB24742
M5 Ultra · 512 GBQ6_KRuns great34 GB24742
M4 · 16 GBUD-IQ2_XXSTight fit11 GB5.725
M4 · 24 GBUD-IQ3_XXSRuns well16 GB4.525
M4 · 32 GBQ4_K_MRuns well21 GB3.225
M4 Pro · 24 GBUD-IQ3_XXSRuns well16 GB9.550
M4 Pro · 48 GBQ4_K_MRuns great22 GB6.950
M4 Pro · 64 GBQ6_KRuns great29 GB5.450
M4 Max · 36 GBQ4_K_MRuns well22 GB9.9100
M4 Max · 48 GBQ4_K_MRuns great22 GB13125
M4 Max · 64 GBQ6_KRuns great29 GB10125
M4 Max · 96 GBQ6_KRuns great34 GB7.7100
M4 Max · 128 GBQ6_KRuns great34 GB10125
M3 · 8 GBQ3_K_MToo big24 GB
M3 · 16 GBUD-IQ2_XXSTight fit11 GB4.921
M3 · 24 GBUD-IQ3_XXSRuns well16 GB3.921
M3 Pro · 18 GBUD-IQ2_XXSRuns well11 GB7.236
M3 Pro · 36 GBQ4_K_MRuns well22 GB436
M3 Max · 36 GBQ4_K_MRuns well22 GB7.677
M3 Max · 48 GBQ4_K_MRuns great22 GB9.9103
M3 Max · 64 GBQ6_KRuns great29 GB7.7103
M3 Max · 96 GBQ6_KRuns great34 GB5.977
M3 Max · 128 GBQ6_KRuns great34 GB7.7103
M3 Ultra · 96 GBQ6_KRuns great34 GB14155
M3 Ultra · 256 GBQ6_KRuns great34 GB14155
M3 Ultra · 512 GBQ6_KRuns great34 GB14206
M2 · 8 GBQ3_K_MToo big24 GB
M2 · 16 GBUD-IQ2_XXSTight fit11 GB4.920
M2 · 24 GBUD-IQ3_XXSRuns well16 GB3.920
M2 Pro · 16 GBUD-IQ2_XXSTight fit11 GB9.341
M2 Pro · 32 GBQ4_K_MRuns well21 GB5.241
M2 Max · 32 GBQ4_K_MRuns well21 GB9.976
M2 Max · 64 GBQ6_KRuns great29 GB7.776
M2 Max · 96 GBQ6_KRuns great34 GB7.796
M2 Ultra · 64 GBQ6_KRuns great29 GB14152
M2 Ultra · 128 GBQ6_KRuns great34 GB14152
M2 Ultra · 192 GBQ6_KRuns great34 GB14152
M1 · 8 GBQ3_K_MToo big24 GB
M1 · 16 GBUD-IQ2_XXSTight fit11 GB3.316
M1 Pro · 16 GBUD-IQ2_XXSTight fit11 GB8.633
M1 Pro · 32 GBQ4_K_MRuns well21 GB533
M1 Max · 32 GBQ4_K_MRuns well21 GB9.156
M1 Max · 64 GBQ6_KRuns great29 GB7.256
M1 Ultra · 64 GBQ6_KRuns great29 GB13113
M1 Ultra · 128 GBQ6_KRuns great34 GB13113

Writes and reads are words a second (a token is about three quarters of a word), 4K tokens into a chat, estimated unless marked measured. The size is the one the store offers that Mac. Constants fitted October 11, 2026; how, and how wrong.

Badge for the model card

Shows on Gemma 4 31B's Hugging Face card which Macs run it well, linked to this page. It updates every morning.

Runs on Mac badge

Sizes and files are read from unsloth/gemma-4-31B-it-GGUF on Hugging Face and checked every morning. The rating is the model's score on the LM Arena text leaderboard (CC BY 4.0), where people vote between two answers without knowing which model wrote which. Catalog of November 4, 2026.

Your Computer

Every model is judged for this Mac. Both are under About This Mac, in the Apple menu.

Every Mac · Every graphics card

Open in OutmakeHugging Face

New to Outmake? Download the free beta