For problems worked through step by step, with its thinking shown apart from the final answer.
- Rating, estimated
- 4.2
- Downloads
- 38K
- Parameters
- 37B, 4B active
- Context
- 512K
- Download
- 11 to 75 GB
- Commercial use
- Yes
Tight fit on M4 · 16 GB
Outmake picks the IQ2_XXS size: a 11 GB download that uses 12 GB of memory, and writes about 6.2 words (8.3 tokens) a second.
About
The sparse member of the K2-Horizon family, so only part of the model runs for each word it writes.
Good to know
Its training data, training recipe and training code are all public, along with the model.
Sources: IFM/K2-Horizon-MoVA-36B-A4B model card, Outmake's speed estimates, LM Arena and Hugging Face. Every line comes from one of these.
Good at
Licence
Apache 2.0. Commercial use: yes. The maker's page has the full terms.
K2-Horizon 36B runs well from a Mac with an M3 Pro and 18 GB of memory, at IQ2_XXS, writing about 7.7 words (10 tokens) a second. 48 of 59 Mac configurations run it well.
Compare with
The nearest models in size, judged for the same Mac.
Sizes
| Size | Download | Memory at 8K | Memory at 32K | Open |
|---|---|---|---|---|
| Q3_K_MSmaller | 17 GB | 18 GB | 21 GB | Open |
| Q4_K_MBalanced | 23 GB | 24 GB | 26 GB | Open |
| Q6_KBest | 32 GB | 33 GB | 36 GB | Open |
All 24 sizes
| Size | Download | Memory at 8K | Memory at 32K | Open |
|---|---|---|---|---|
| IQ2_XXS | 11 GB | 12 GBestimated | 14 GB | Open |
| IQ2_XS | 12 GB | 13 GBestimated | 15 GB | Open |
| IQ2_S | 12 GB | 13 GBestimated | 16 GB | Open |
| IQ2_M | 13 GB | 14 GBestimated | 17 GB | Open |
| Q2_K | 14 GB | 15 GBestimated | 17 GB | Open |
| IQ3_XXS | 16 GB | 17 GBestimated | 20 GB | Open |
| Q3_K_S | 17 GB | 18 GBestimated | 20 GB | Open |
| IQ3_XS | 17 GB | 18 GBestimated | 21 GB | Open |
| Q3_K_L | 18 GB | 19 GBestimated | 22 GB | Open |
| IQ3_M | 18 GB | 19 GBestimated | 22 GB | Open |
| IQ4_XS | 20 GB | 21 GBestimated | 24 GB | Open |
| IQ4_NL | 22 GB | 23 GBestimated | 25 GB | Open |
| Q4_0 | 22 GB | 23 GBestimated | 25 GB | Open |
| Q4_K_S | 22 GB | 23 GBestimated | 26 GB | Open |
| Q4_K_L | 23 GB | 24 GBestimated | 27 GB | Open |
| Q4_1 | 24 GB | 25 GBestimated | 27 GB | Open |
| Q5_K_S | 26 GB | 27 GBestimated | 30 GB | Open |
| Q5_K_M | 27 GB | 28 GBestimated | 30 GB | Open |
| Q6_K_L | 32 GB | 33 GBestimated | 36 GB | Open |
| Q8_0 | 40 GB | 41 GBestimated | 43 GB | Open |
| BF16 | 75 GB | 76 GBestimated | 78 GB | Open |
Memory is what llama.cpp's own calculator reported for each size when the catalog was built, with the app's settings. Smaller, Balanced and Best are the three sizes the store names.
Run It Anywhere
K2-Horizon 36B is an open model, so any app that runs GGUF files can run it. These take the Q4_K_M size from bartowski straight from Hugging Face.
- LM StudioMac, Windows, Linux
Open - JanMac, Windows, Linux
Open - MstyMac, Windows, Linux
Open - OllamaMac, Windows, Linux
ollama run hf.co/bartowski/K2-Horizon-MoVA-36B-A4B-GGUF:Q4_K_M - llama.cppMac, Windows, Linux
llama-server -hf bartowski/K2-Horizon-MoVA-36B-A4B-GGUF:Q4_K_M - Docker Model RunnerMac, Windows, Linux
docker model run hf.co/bartowski/K2-Horizon-MoVA-36B-A4B-GGUF:Q4_K_M
On a PC Graphics Card
| Video memory | Largest size that fits | Download | Memory at 8K |
|---|---|---|---|
| 6 GB | None worth running | needs 17 GB | |
| 8 GB | None worth running | needs 17 GB | |
| 10 GB | None worth running | needs 17 GB | |
| 11 GB | None worth running | needs 17 GB | |
| 12 GB | None worth running | needs 17 GB | |
| 16 GB | None worth running | needs 17 GB | |
| 20 GB | IQ3_M | 18 GB | 19 GB |
| 24 GB | Q4_K_S | 22 GB | 23 GB |
| 32 GB | Q5_K_M | 27 GB | 28 GB |
| 48 GB | Q8_0 | 40 GB | 41 GB |
The largest size, of those that keep three bits a weight or more, whose memory at an 8K chat is under 92% of the card's; the rest is the desktop's. Estimated from the files, the same way as for a Mac; speed on a PC is not estimated yet. A size that doesn't fit the card still runs, slower, with part of it in ordinary memory.
On every Mac
| Mac | Size | Fit | Memory | Writes | Reads |
|---|---|---|---|---|---|
| M6 · 16 GB | IQ2_XXS | Tight fit | 12 GB | 9.2 | 1100 |
| M6 · 24 GB | Q2_K | Runs well | 15 GB | 8.8 | 1100 |
| M6 · 32 GB | Q3_K_M | Runs well | 21 GB | 8.4 | 1100 |
| M5 · 16 GB | IQ2_XXS | Tight fit | 12 GB | 8.5 | 406 |
| M5 · 24 GB | Q2_K | Runs well | 15 GB | 8.1 | 406 |
| M5 · 32 GB | Q3_K_M | Runs well | 21 GB | 7.7 | 406 |
| M5 Pro · 24 GB | Q2_K | Runs well | 15 GB | 16 | 813 |
| M5 Pro · 48 GB | Q3_K_M | Runs great | 21 GB | 15 | 813 |
| M5 Pro · 64 GB | Q4_K_M | Runs great | 26 GB | 14 | 1016 |
| M5 Max · 36 GB | Q4_K_M | Runs well | 24 GB | 20 | 1625 |
| M5 Max · 48 GB | Q3_K_M | Runs great | 21 GB | 28 | 2032 |
| M5 Max · 64 GB | Q4_K_M | Runs great | 26 GB | 26 | 2032 |
| M5 Max · 128 GB | Q6_K | Runs great | 60 GB | 24 | 2032 |
| M5 Ultra · 96 GB | Q6_K | Runs great | 46 GB | 44 | 3250 |
| M5 Ultra · 256 GB | Q6_K | Runs great | 60 GB | 44 | 4063 |
| M5 Ultra · 512 GB | Q6_K | Runs great | 60 GB | 44 | 4063 |
| M4 · 16 GB | IQ2_XXS | Tight fit | 12 GB | 6.2 | 137 |
| M4 · 24 GB | Q2_K | Runs well | 15 GB | 6 | 137 |
| M4 · 32 GB | Q3_K_M | Runs well | 21 GB | 5.7 | 137 |
| M4 Pro · 24 GB | Q2_K | Runs well | 15 GB | 12 | 273 |
| M4 Pro · 48 GB | Q3_K_M | Runs great | 21 GB | 12 | 273 |
| M4 Pro · 64 GB | Q4_K_M | Runs great | 26 GB | 11 | 273 |
| M4 Max · 36 GB | Q4_K_M | Runs well | 24 GB | 15 | 546 |
| M4 Max · 48 GB | Q3_K_M | Runs great | 21 GB | 20 | 683 |
| M4 Max · 64 GB | Q4_K_M | Runs great | 26 GB | 19 | 683 |
| M4 Max · 96 GB | Q6_K | Runs great | 46 GB | 14 | 546 |
| M4 Max · 128 GB | Q6_K | Runs great | 60 GB | 17 | 683 |
| M3 · 8 GB | Q3_K_M | Too big | 46 GB | ||
| M3 · 16 GB | IQ2_XXS | Tight fit | 12 GB | 5.4 | 113 |
| M3 · 24 GB | Q2_K | Runs well | 15 GB | 5.1 | 113 |
| M3 Pro · 18 GB | IQ2_XXS | Runs well | 12 GB | 7.7 | 198 |
| M3 Pro · 36 GB | Q4_K_M | Runs well | 24 GB | 6.7 | 198 |
| M3 Max · 36 GB | Q4_K_M | Runs well | 24 GB | 12 | 424 |
| M3 Max · 48 GB | Q3_K_M | Runs great | 21 GB | 16 | 565 |
| M3 Max · 64 GB | Q4_K_M | Runs great | 26 GB | 15 | 565 |
| M3 Max · 96 GB | Q6_K | Runs great | 46 GB | 11 | 424 |
| M3 Max · 128 GB | Q6_K | Runs great | 60 GB | 14 | 565 |
| M3 Ultra · 96 GB | Q6_K | Runs great | 46 GB | 24 | 848 |
| M3 Ultra · 256 GB | Q6_K | Runs great | 60 GB | 24 | 848 |
| M3 Ultra · 512 GB | Q6_K | Runs great | 60 GB | 24 | 1130 |
| M2 · 8 GB | Q3_K_M | Too big | 46 GB | ||
| M2 · 16 GB | IQ2_XXS | Tight fit | 12 GB | 5.3 | 111 |
| M2 · 24 GB | Q2_K | Runs well | 15 GB | 5.1 | 111 |
| M2 Pro · 16 GB | IQ2_XXS | Tight fit | 12 GB | 9.9 | 222 |
| M2 Pro · 32 GB | Q3_K_M | Runs well | 21 GB | 9.2 | 222 |
| M2 Max · 32 GB | Q3_K_M | Runs well | 21 GB | 16 | 416 |
| M2 Max · 64 GB | Q4_K_M | Runs great | 26 GB | 15 | 416 |
| M2 Max · 96 GB | Q6_K | Runs great | 46 GB | 14 | 527 |
| M2 Ultra · 64 GB | Q4_K_M | Runs great | 26 GB | 25 | 832 |
| M2 Ultra · 128 GB | Q6_K | Runs great | 60 GB | 24 | 832 |
| M2 Ultra · 192 GB | Q6_K | Runs great | 60 GB | 24 | 832 |
| M1 · 8 GB | Q3_K_M | Too big | 46 GB | ||
| M1 · 16 GB | IQ2_XXS | Tight fit | 12 GB | 3.6 | 90 |
| M1 Pro · 16 GB | IQ2_XXS | Tight fit | 12 GB | 9.1 | 180 |
| M1 Pro · 32 GB | Q3_K_M | Runs well | 21 GB | 8.5 | 180 |
| M1 Max · 32 GB | Q3_K_M | Runs well | 21 GB | 14 | 308 |
| M1 Max · 64 GB | Q4_K_M | Runs great | 26 GB | 13 | 308 |
| M1 Ultra · 64 GB | Q4_K_M | Runs great | 26 GB | 21 | 617 |
| M1 Ultra · 128 GB | Q6_K | Runs great | 60 GB | 19 | 617 |
Writes and reads are words a second (a token is about three quarters of a word), 4K tokens into a chat, estimated unless marked measured. The size is the one the store offers that Mac. Constants fitted October 11, 2026; how, and how wrong.
Badge for the model card
Shows on K2-Horizon 36B's Hugging Face card which Macs run it well, linked to this page. It updates every morning.
Sizes and files are read from bartowski/K2-Horizon-MoVA-36B-A4B-GGUF on Hugging Face and checked every morning. LM Arena has not rated this model, so the rating is Outmake's estimate from its size and release date; how the estimate is made. Catalog of November 4, 2026.
