Zai Org
GLM 5
- Weights at 16-bit
- 1,508 GB
- Weights at 8-bit (Q8_0)
- 801 GB
- Weights at 4-bit (Q4_K_M)
- 457 GB
- Smallest card at 4-bit
- More than one card
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Experts
- Experts per token
- GGUF downloads
-
repo bytes files quant unsloth/GLM-5-GGUF 176,142,433,184 1 entries UD-TQ1_0 unsloth/GLM-5-GGUF 203,699,011,168 6 entries UD-IQ1_S unsloth/GLM-5-GGUF 223,855,224,416 6 entries UD-IQ1_M unsloth/GLM-5-GGUF 241,073,170,016 6 entries UD-IQ2_XXS unsloth/GLM-5-GGUF 254,763,378,336 7 entries UD-IQ2_M unsloth/GLM-5-GGUF 275,953,473,216 7 entries Q2_K unsloth/GLM-5-GGUF 276,176,500,448 7 entries Q2_K_L unsloth/GLM-5-GGUF 281,382,790,880 7 entries UD-Q2_K_XL unsloth/GLM-5-GGUF 304,536,467,744 8 entries UD-IQ3_XXS unsloth/GLM-5-GGUF 326,276,833,568 8 entries Q3_K_S unsloth/GLM-5-GGUF 332,461,357,376 8 entries UD-Q3_K_XL unsloth/GLM-5-GGUF 360,308,302,304 9 entries Q3_K_M unsloth/GLM-5-GGUF 402,895,582,272 10 entries IQ4_XS unsloth/GLM-5-GGUF 410,557,924,192 10 entries MXFP4_MOE unsloth/GLM-5-GGUF 425,923,884,032 10 entries IQ4_NL unsloth/GLM-5-GGUF 427,145,999,360 10 entries Q4_0 unsloth/GLM-5-GGUF 428,368,114,688 10 entries Q4_K_S unsloth/GLM-5-GGUF 430,704,800,768 10 entries UD-Q4_K_XL unsloth/GLM-5-GGUF 455,879,275,712 11 entries Q4_K_M unsloth/GLM-5-GGUF 472,704,107,744 11 entries Q4_1 unsloth/GLM-5-GGUF 519,738,348,800 12 entries Q5_K_S unsloth/GLM-5-GGUF 535,169,914,112 12 entries Q5_K_M unsloth/GLM-5-GGUF 536,222,946,560 12 entries UD-Q5_K_XL unsloth/GLM-5-GGUF 619,377,928,352 14 entries Q6_K unsloth/GLM-5-GGUF 645,157,970,208 15 entries UD-Q6_K_XL unsloth/GLM-5-GGUF 801,344,964,608 18 entries Q8_0 unsloth/GLM-5-GGUF 868,774,627,424 19 entries UD-Q8_K_XL unsloth/GLM-5-GGUF 1,507,979,369,824 33 entries BF16 - Head size
- Hidden size
- KV heads
- KV latent rank (MLA)
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- RoPE key size (MLA)
- Shared experts
- Task