Hugging FaceA 123B chat model from Mistral AI.
- Downloads
- 6.4K
- Likes
- 61
- Parameters
- 123B
- Context
- 32K
- Licence
- other
Too big for this Mac
Its smallest size needs 33 GB of memory, more than M4 · 16 GB can give it.
Ratings
MMLU-Pro: graduate-level questions in 14 subjects. Scores are the ones filed on the model's Hugging Face page or the board's own table, read 2026-11-05; some come from the maker.
Mistral Large 2407 runs well from a Mac with an M3 Max and 48 GB of memory. 29 of 59 Mac configurations run it well.
Compare with
The nearest models in size.
- Mistral Large 2411Mistral AI · 35K downloadsToo big for this Mac · 28 GB
- NVIDIA Nemotron 3 Super 120B A12B BF16NVIDIA · 2.3K downloadsToo big for this Mac · 54 GB
- Ornith 1.5 122Bornith-ai · 1.2M downloadsToo big for this Mac · 30 GB
- Qwen3.5 122BAlibaba Qwen · 208K downloads · Arena 1416Too big for this Mac · 29 GB
Sizes
From bartowski/Mistral-Large-Instruct-2407-GGUF on Hugging Face. A smaller size is a smaller download and a little less accurate.
| Size | Download | Memory at 8K | Get |
|---|---|---|---|
| IQ1_M | 28 GB | 30 GBestimated | Open |
| IQ2_XXS | 32 GB | 34 GBestimated | Open |
| IQ2_XS | 36 GB | 38 GBestimated | Open |
| IQ2_M | 42 GB | 43 GBestimated | Open |
| Q2_K | 45 GB | 47 GBestimated | Open |
| Q2_K_L | 46 GB | 47 GBestimated | Open |
| IQ3_XXS | 47 GB | 49 GBestimated | Open |
| Q3_K_S | 53 GB | 55 GBestimated | Open |
| IQ3_M | 55 GB | 57 GBestimated | Open |
| Q3_K_M | 59 GB | 61 GBestimated | Open |
| Q3_K_L | 65 GB | 66 GBestimated | Open |
| Q3_K_XL | 65 GB | 67 GBestimated | Open |
| IQ4_XS | 65 GB | 67 GBestimated | Open |
| Q4_0_4_4 | 69 GB | 71 GBestimated | Open |
| Q4_0 | 69 GB | 71 GBestimated | Open |
| Q4_K_S | 70 GB | 71 GBestimated | Open |
| Q4_K_M | 73 GB | 75 GBestimated | Open |
| Q5_K_S | 84 GB | 86 GBestimated | Open |
| Q5_K_M | 86 GB | 88 GBestimated | Open |
| Q6_K | 101 GB | 102 GBestimated | Open |
| Q8_0 | 130 GB | 132 GBestimated | Open |
Run It Anywhere
Mistral Large 2407 is an open model, so any app that runs GGUF files can run it. These take the IQ1_M size from bartowski straight from Hugging Face.
- LM StudioMac, Windows, Linux
Open - JanMac, Windows, Linux
Open - MstyMac, Windows, Linux
Open - OllamaMac, Windows, Linux
ollama run hf.co/bartowski/Mistral-Large-Instruct-2407-GGUF:IQ1_M - llama.cppMac, Windows, Linux
llama-server -hf bartowski/Mistral-Large-Instruct-2407-GGUF:IQ1_M - Docker Model RunnerMac, Windows, Linux
docker model run hf.co/bartowski/Mistral-Large-Instruct-2407-GGUF:IQ1_M
On a PC Graphics Card
| Video memory | Largest size that fits | Download | Memory at 8K |
|---|---|---|---|
| 6 GB | None worth running | needs 49 GB | |
| 8 GB | None worth running | needs 49 GB | |
| 10 GB | None worth running | needs 49 GB | |
| 11 GB | None worth running | needs 49 GB | |
| 12 GB | None worth running | needs 49 GB | |
| 16 GB | None worth running | needs 49 GB | |
| 20 GB | None worth running | needs 49 GB | |
| 24 GB | None worth running | needs 49 GB | |
| 32 GB | None worth running | needs 49 GB | |
| 48 GB | None worth running | needs 49 GB |
The largest size, of those that keep three bits a weight or more, whose memory at an 8K chat is under 92% of the card's; the rest is the desktop's. Estimated from the files, the same way as for a Mac; speed on a PC is not estimated yet. A size that doesn't fit the card still runs, slower, with part of it in ordinary memory.
On every Mac
| Mac | Size | Fit | Memory | Writes |
|---|---|---|---|---|
| M6 · 16 GB | IQ1_S | Too big | 33 GB | |
| M6 · 24 GB | IQ1_S | Too big | 33 GB | |
| M6 · 32 GB | IQ1_S | Too big | 33 GB | |
| M5 · 16 GB | IQ1_S | Too big | 33 GB | |
| M5 · 24 GB | IQ1_S | Too big | 33 GB | |
| M5 · 32 GB | IQ1_S | Too big | 33 GB | |
| M5 Pro · 24 GB | IQ1_S | Too big | 33 GB | |
| M5 Pro · 48 GB | IQ1_M | Runs well | 32 GB | 4.3 |
| M5 Pro · 64 GB | IQ1_M | Runs great | 30 GB | 4.3 |
| M5 Max · 36 GB | IQ1_S | Tight fit | 28 GB | 6.8 |
| M5 Max · 48 GB | IQ1_M | Runs well | 32 GB | 8.4 |
| M5 Max · 64 GB | IQ1_M | Runs great | 30 GB | 8.4 |
| M5 Max · 128 GB | IQ4_XS | Runs great | 67 GB | 4.4 |
| M5 Ultra · 96 GB | IQ4_XS | Runs well | 67 GB | 8.7 |
| M5 Ultra · 256 GB | Q8_0 | Runs great | 137 GB | 5.7 |
| M5 Ultra · 512 GB | Q8_0 | Runs great | 137 GB | 5.7 |
| M4 · 16 GB | IQ1_S | Too big | 33 GB | |
| M4 · 24 GB | IQ1_S | Too big | 33 GB | |
| M4 · 32 GB | IQ1_S | Too big | 33 GB | |
| M4 Pro · 24 GB | IQ1_S | Too big | 33 GB | |
| M4 Pro · 48 GB | IQ1_M | Runs well | 32 GB | 3.7 |
| M4 Pro · 64 GB | IQ1_M | Runs great | 30 GB | 3.7 |
| M4 Max · 36 GB | IQ1_S | Tight fit | 28 GB | 5.7 |
| M4 Max · 48 GB | IQ1_M | Runs well | 32 GB | 6.9 |
| M4 Max · 64 GB | IQ1_M | Runs great | 30 GB | 6.9 |
| M4 Max · 96 GB | IQ4_XS | Runs well | 67 GB | 3 |
| M4 Max · 128 GB | IQ4_XS | Runs great | 67 GB | 3.9 |
| M3 · 8 GB | IQ1_S | Too big | 33 GB | |
| M3 · 16 GB | IQ1_S | Too big | 33 GB | |
| M3 · 24 GB | IQ1_S | Too big | 33 GB | |
| M3 Pro · 18 GB | IQ1_S | Too big | 33 GB | |
| M3 Pro · 36 GB | IQ1_S | Tight fit | 28 GB | 2.3 |
| M3 Max · 36 GB | IQ1_S | Tight fit | 28 GB | 4.4 |
| M3 Max · 48 GB | IQ1_M | Runs well | 32 GB | 5.4 |
| M3 Max · 64 GB | IQ1_M | Runs great | 30 GB | 5.4 |
| M3 Max · 96 GB | IQ4_XS | Runs well | 67 GB | 2.2 |
| M3 Max · 128 GB | IQ4_XS | Runs great | 67 GB | 2.9 |
| M3 Ultra · 96 GB | IQ4_XS | Runs well | 67 GB | 5.6 |
| M3 Ultra · 256 GB | Q8_0 | Runs great | 137 GB | 3.6 |
| M3 Ultra · 512 GB | Q8_0 | Runs great | 137 GB | 3.6 |
| M2 · 8 GB | IQ1_S | Too big | 33 GB | |
| M2 · 16 GB | IQ1_S | Too big | 33 GB | |
| M2 · 24 GB | IQ1_S | Too big | 33 GB | |
| M2 Pro · 16 GB | IQ1_S | Too big | 33 GB | |
| M2 Pro · 32 GB | IQ1_S | Too big | 33 GB | |
| M2 Max · 32 GB | IQ1_S | Too big | 33 GB | |
| M2 Max · 64 GB | IQ1_M | Runs great | 30 GB | 5.4 |
| M2 Max · 96 GB | IQ4_XS | Runs well | 67 GB | 2.9 |
| M2 Ultra · 64 GB | IQ1_M | Runs great | 30 GB | 9.8 |
| M2 Ultra · 128 GB | IQ4_XS | Runs great | 67 GB | 5.5 |
| M2 Ultra · 192 GB | Q6_K | Runs great | 108 GB | 3.9 |
| M1 · 8 GB | IQ1_S | Too big | 33 GB | |
| M1 · 16 GB | IQ1_S | Too big | 33 GB | |
| M1 Pro · 16 GB | IQ1_S | Too big | 33 GB | |
| M1 Pro · 32 GB | IQ1_S | Too big | 33 GB | |
| M1 Max · 32 GB | IQ1_S | Too big | 33 GB | |
| M1 Max · 64 GB | IQ1_M | Runs great | 30 GB | 5.1 |
| M1 Ultra · 64 GB | IQ1_M | Runs great | 30 GB | 8.8 |
| M1 Ultra · 128 GB | IQ4_XS | Runs great | 67 GB | 5.2 |
Writes is words a second, estimated from the Mac's memory speed and the model's size; how, and how wrong.
Packaged by
2 repositories on Hugging Face carry this model for llama.cpp. Outmake reads them all as one model.
Information
- Maker
- Mistral AI
- Released
- July 2024
- Parameters
- 123B
- Longest chat
- 32K tokens
- Reads pictures
- No
- Licence
- other
- Downloads this month
- 6,377
- Likes
- 61
- Sizes
- 21, 28 to 130 GB
- Kind
- Maker's release
Badge for the model card
Shows on Mistral Large 2407's Hugging Face card which Macs run it well, linked to this page. It updates every morning.
Files, downloads and likes read from Hugging Face on November 5, 2026 and refreshed every morning. Memory and speed are estimates until someone running Outmake measures this model on that Mac.