Hugging FaceA community version of another maker's model.
- Rating
- 1.6
- Downloads
- 1.1K
- Likes
- 1
- Parameters
- 6.2B
- Context
- 8K
Runs great on M4 · 16 GB
The Q8_0 size from mradermacher is the one to get: a 6.6 GB download that uses 6.9 GB of memory, and writes about 10 words a second.
Ratings
1.6 out of 5, across people's blind votes on its answers.
LM Arena ratings of October 28, 2026 (CC BY 4.0): people vote between two answers without knowing which model wrote which. The bar ends at 1488, the best any open model has. The Arena tests the full model; a small size on a Mac answers a little worse.
Chatglm3 6B runs well from a Mac with an M1 and 8 GB of memory. 59 of 59 Mac configurations run it well. It is a re-tune or merge made by someone other than the original model's maker, so its ratings, where it has any, are its own.
Compare with
The nearest models in size.
Sizes
From mradermacher/chatglm3-6b-GGUF on Hugging Face. A smaller size is a smaller download and a little less accurate.
| Size | Download | Memory at 8K | Get |
|---|---|---|---|
| Q2_K | 2.6 GB | 2.8 GBestimated | Open |
| Q3_K_S | 3.0 GB | 3.2 GBestimated | Open |
| Q3_K_M | 3.3 GB | 3.6 GBestimated | Open |
| IQ4_XS | 3.5 GB | 3.7 GBestimated | Open |
| Q3_K_L | 3.5 GB | 3.7 GBestimated | Open |
| Q4_K_S | 3.8 GB | 4.0 GBestimated | Open |
| Q4_K_M | 4.1 GB | 4.4 GBestimated | Open |
| Q5_K_S | 4.4 GB | 4.7 GBestimated | Open |
| Q5_K_M | 4.7 GB | 5.0 GBestimated | Open |
| Q6_K | 5.5 GB | 5.7 GBestimated | Open |
| Q8_0 | 6.6 GB | 6.9 GBestimated | Open |
| F16 | 12 GB | 13 GBestimated | Open |
Run It Anywhere
Chatglm3 6B is an open model, so any app that runs GGUF files can run it. These take the Q8_0 size from mradermacher straight from Hugging Face.
- LM StudioMac, Windows, Linux
Open - JanMac, Windows, Linux
Open - MstyMac, Windows, Linux
Open - OllamaMac, Windows, Linux
ollama run hf.co/mradermacher/chatglm3-6b-GGUF:Q8_0 - llama.cppMac, Windows, Linux
llama-server -hf mradermacher/chatglm3-6b-GGUF:Q8_0 - Docker Model RunnerMac, Windows, Linux
docker model run hf.co/mradermacher/chatglm3-6b-GGUF:Q8_0
On a PC Graphics Card
| Video memory | Largest size that fits | Download | Memory at 8K |
|---|---|---|---|
| 6 GB | Q6_K | 5.5 GB | 5.7 GB |
| 8 GB | Q8_0 | 6.6 GB | 6.9 GB |
| 10 GB | Q8_0 | 6.6 GB | 6.9 GB |
| 11 GB | Q8_0 | 6.6 GB | 6.9 GB |
| 12 GB | Q8_0 | 6.6 GB | 6.9 GB |
| 16 GB | F16 | 12 GB | 13 GB |
| 20 GB | F16 | 12 GB | 13 GB |
| 24 GB | F16 | 12 GB | 13 GB |
| 32 GB | F16 | 12 GB | 13 GB |
| 48 GB | F16 | 12 GB | 13 GB |
The largest size, of those that keep three bits a weight or more, whose memory at an 8K chat is under 92% of the card's; the rest is the desktop's. Estimated from the files, the same way as for a Mac; speed on a PC is not estimated yet. A size that doesn't fit the card still runs, slower, with part of it in ordinary memory.
On every Mac
| Mac | Size | Fit | Memory | Writes |
|---|---|---|---|---|
| M6 · 16 GB | Q8_0 | Runs great | 6.9 GB | 15 |
| M6 · 24 GB | Q8_0 | Runs great | 6.9 GB | 15 |
| M6 · 32 GB | Q8_0 | Runs great | 6.9 GB | 15 |
| M5 · 16 GB | Q8_0 | Runs great | 6.9 GB | 14 |
| M5 · 24 GB | Q8_0 | Runs great | 6.9 GB | 14 |
| M5 · 32 GB | Q8_0 | Runs great | 6.9 GB | 14 |
| M5 Pro · 24 GB | Q8_0 | Runs great | 6.9 GB | 27 |
| M5 Pro · 48 GB | Q8_0 | Runs great | 6.9 GB | 27 |
| M5 Pro · 64 GB | Q8_0 | Runs great | 6.9 GB | 27 |
| M5 Max · 36 GB | Q8_0 | Runs great | 6.9 GB | 39 |
| M5 Max · 48 GB | Q8_0 | Runs great | 6.9 GB | 51 |
| M5 Max · 64 GB | Q8_0 | Runs great | 6.9 GB | 51 |
| M5 Max · 128 GB | Q8_0 | Runs great | 6.9 GB | 51 |
| M5 Ultra · 96 GB | Q8_0 | Runs great | 6.9 GB | 95 |
| M5 Ultra · 256 GB | Q8_0 | Runs great | 6.9 GB | 95 |
| M5 Ultra · 512 GB | Q8_0 | Runs great | 6.9 GB | 95 |
| M4 · 16 GB | Q8_0 | Runs great | 6.9 GB | 10 |
| M4 · 24 GB | Q8_0 | Runs great | 6.9 GB | 10 |
| M4 · 32 GB | Q8_0 | Runs great | 6.9 GB | 10 |
| M4 Pro · 24 GB | Q8_0 | Runs great | 6.9 GB | 21 |
| M4 Pro · 48 GB | Q8_0 | Runs great | 6.9 GB | 21 |
| M4 Pro · 64 GB | Q8_0 | Runs great | 6.9 GB | 21 |
| M4 Max · 36 GB | Q8_0 | Runs great | 6.9 GB | 30 |
| M4 Max · 48 GB | Q8_0 | Runs great | 6.9 GB | 38 |
| M4 Max · 64 GB | Q8_0 | Runs great | 6.9 GB | 38 |
| M4 Max · 96 GB | Q8_0 | Runs great | 6.9 GB | 30 |
| M4 Max · 128 GB | Q8_0 | Runs great | 6.9 GB | 38 |
| M3 · 8 GB | Q3_K_L | Runs great | 3.7 GB | 13 |
| M3 · 16 GB | Q8_0 | Runs great | 6.9 GB | 8.6 |
| M3 · 24 GB | Q8_0 | Runs great | 6.9 GB | 8.6 |
| M3 Pro · 18 GB | Q8_0 | Runs great | 6.9 GB | 13 |
| M3 Pro · 36 GB | Q8_0 | Runs great | 6.9 GB | 13 |
| M3 Max · 36 GB | Q8_0 | Runs great | 6.9 GB | 24 |
| M3 Max · 48 GB | Q8_0 | Runs great | 6.9 GB | 30 |
| M3 Max · 64 GB | Q8_0 | Runs great | 6.9 GB | 30 |
| M3 Max · 96 GB | Q8_0 | Runs great | 6.9 GB | 24 |
| M3 Max · 128 GB | Q8_0 | Runs great | 6.9 GB | 30 |
| M3 Ultra · 96 GB | Q8_0 | Runs great | 6.9 GB | 53 |
| M3 Ultra · 256 GB | Q8_0 | Runs great | 6.9 GB | 53 |
| M3 Ultra · 512 GB | Q8_0 | Runs great | 6.9 GB | 53 |
| M2 · 8 GB | Q3_K_L | Runs great | 3.7 GB | 13 |
| M2 · 16 GB | Q8_0 | Runs great | 6.9 GB | 8.6 |
| M2 · 24 GB | Q8_0 | Runs great | 6.9 GB | 8.6 |
| M2 Pro · 16 GB | Q8_0 | Runs great | 6.9 GB | 16 |
| M2 Pro · 32 GB | Q8_0 | Runs great | 6.9 GB | 16 |
| M2 Max · 32 GB | Q8_0 | Runs great | 6.9 GB | 30 |
| M2 Max · 64 GB | Q8_0 | Runs great | 6.9 GB | 30 |
| M2 Max · 96 GB | Q8_0 | Runs great | 6.9 GB | 30 |
| M2 Ultra · 64 GB | Q8_0 | Runs great | 6.9 GB | 53 |
| M2 Ultra · 128 GB | Q8_0 | Runs great | 6.9 GB | 53 |
| M2 Ultra · 192 GB | Q8_0 | Runs great | 6.9 GB | 53 |
| M1 · 8 GB | Q3_K_L | Runs great | 3.7 GB | 8.4 |
| M1 · 16 GB | Q8_0 | Runs great | 6.9 GB | 5.8 |
| M1 Pro · 16 GB | Q8_0 | Runs great | 6.9 GB | 16 |
| M1 Pro · 32 GB | Q8_0 | Runs great | 6.9 GB | 16 |
| M1 Max · 32 GB | Q8_0 | Runs great | 6.9 GB | 28 |
| M1 Max · 64 GB | Q8_0 | Runs great | 6.9 GB | 28 |
| M1 Ultra · 64 GB | Q8_0 | Runs great | 6.9 GB | 45 |
| M1 Ultra · 128 GB | Q8_0 | Runs great | 6.9 GB | 45 |
Writes is words a second, estimated from the Mac's memory speed and the model's size; how, and how wrong.
Information
- Maker
- Z.ai
- Released
- October 2023
- Parameters
- 6.2B
- Longest chat
- 8K tokens
- Reads pictures
- No
- Licence
- Not stated
- Downloads this month
- 1,119
- Likes
- 1
- Sizes
- 12, 2.6 to 12 GB
- Kind
- Community version
- Source
- zai-org/chatglm3-6b
Badge for the model card
Shows on Chatglm3 6B's Hugging Face card which Macs run it well, linked to this page. It updates every morning.
Files, downloads and likes read from Hugging Face on November 5, 2026 and refreshed every morning. Memory and speed are estimates until someone running Outmake measures this model on that Mac.