Zai Org
GLM 4.5 Air
- Weights at 16-bit
- 221 GB
- Weights at 8-bit (Q8_0)
- 117 GB
- Weights at 4-bit (Q4_K_M)
- 67 GB
- Smallest card at 4-bit
- More than one card
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Experts
- Experts per token
- GGUF downloads
-
repo bytes files quant unsloth/GLM-4.5-Air-GGUF 38,260,919,360 1 entries UD-TQ1_0 unsloth/GLM-4.5-Air-GGUF 38,503,140,416 1 entries UD-IQ1_S unsloth/GLM-4.5-Air-GGUF 40,061,520,960 1 entries UD-IQ1_M unsloth/GLM-4.5-Air-GGUF 42,682,240,064 1 entries UD-IQ2_XXS unsloth/GLM-4.5-Air-GGUF 44,389,321,792 1 entries UD-IQ2_M unsloth/GLM-4.5-Air-GGUF 45,322,103,872 1 entries Q2_K unsloth/GLM-4.5-Air-GGUF 45,467,593,792 1 entries Q2_K_L unsloth/GLM-4.5-Air-GGUF 47,444,888,640 1 entries UD-Q2_K_XL unsloth/GLM-4.5-Air-GGUF 51,445,288,224 2 entries UD-IQ3_XXS unsloth/GLM-4.5-Air-GGUF 52,655,381,792 2 entries Q3_K_S unsloth/GLM-4.5-Air-GGUF 54,785,805,600 2 entries UD-Q3_K_XL unsloth/GLM-4.5-Air-GGUF 57,203,694,848 2 entries Q3_K_M unsloth/GLM-4.5-Air-GGUF 60,480,900,352 2 entries IQ4_XS unsloth/GLM-4.5-Air-GGUF 62,710,615,296 2 entries IQ4_NL unsloth/GLM-4.5-Air-GGUF 62,781,050,112 2 entries Q4_0 unsloth/GLM-4.5-Air-GGUF 67,033,386,240 2 entries Q4_K_S unsloth/GLM-4.5-Air-GGUF 67,721,071,872 2 entries UD-Q4_K_XL unsloth/GLM-4.5-Air-GGUF 69,407,886,592 2 entries Q4_1 unsloth/GLM-4.5-Air-GGUF 72,975,748,384 2 entries Q4_K_M unsloth/GLM-4.5-Air-GGUF 78,417,661,216 2 entries Q5_K_S unsloth/GLM-4.5-Air-GGUF 82,845,023,520 2 entries UD-Q5_K_XL unsloth/GLM-4.5-Air-GGUF 83,519,589,632 2 entries Q5_K_M unsloth/GLM-4.5-Air-GGUF 99,007,528,192 2 entries Q6_K unsloth/GLM-4.5-Air-GGUF 101,557,079,424 3 entries UD-Q6_K_XL unsloth/GLM-4.5-Air-GGUF 117,456,506,240 3 entries Q8_0 unsloth/GLM-4.5-Air-GGUF 127,740,333,440 3 entries UD-Q8_K_XL unsloth/GLM-4.5-Air-GGUF 220,997,406,080 5 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Shared experts
- Task