DeepSeek
DeepSeek v3.2
- Weights at 16-bit
- 1,371 GB
- Weights at 8-bit (Q8_0)
- 728 GB
- Weights at 4-bit (Q4_K_M)
- 415 GB
- Smallest card at 4-bit
- More than one card
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Experts
- Experts per token
- GGUF downloads
-
repo bytes files quant unsloth/DeepSeek-V3.2-GGUF 161,280,830,528 1 entries UD-TQ1_0 unsloth/DeepSeek-V3.2-GGUF 184,123,010,560 4 entries UD-IQ1_S unsloth/DeepSeek-V3.2-GGUF 199,310,536,320 5 entries UD-IQ1_M unsloth/DeepSeek-V3.2-GGUF 217,127,382,688 5 entries UD-IQ2_XXS unsloth/DeepSeek-V3.2-GGUF 228,110,708,352 5 entries UD-IQ2_M unsloth/DeepSeek-V3.2-GGUF 245,363,998,336 5 entries Q2_K unsloth/DeepSeek-V3.2-GGUF 245,581,188,736 5 entries Q2_K_L unsloth/DeepSeek-V3.2-GGUF 246,610,259,712 6 entries UD-Q2_K_XL unsloth/DeepSeek-V3.2-GGUF 273,130,614,560 6 entries UD-IQ3_XXS unsloth/DeepSeek-V3.2-GGUF 290,448,369,344 6 entries Q3_K_S unsloth/DeepSeek-V3.2-GGUF 320,231,581,568 7 entries Q3_K_M unsloth/DeepSeek-V3.2-GGUF 321,025,585,056 7 entries UD-Q3_K_XL unsloth/DeepSeek-V3.2-GGUF 358,347,337,632 8 entries IQ4_XS unsloth/DeepSeek-V3.2-GGUF 379,135,963,104 8 entries IQ4_NL unsloth/DeepSeek-V3.2-GGUF 380,088,791,008 8 entries Q4_0 unsloth/DeepSeek-V3.2-GGUF 381,056,757,728 8 entries Q4_K_S unsloth/DeepSeek-V3.2-GGUF 405,398,024,320 9 entries Q4_K_M unsloth/DeepSeek-V3.2-GGUF 407,804,145,760 9 entries UD-Q4_K_XL unsloth/DeepSeek-V3.2-GGUF 420,771,131,520 9 entries Q4_1 unsloth/DeepSeek-V3.2-GGUF 462,632,464,576 10 entries Q5_K_S unsloth/DeepSeek-V3.2-GGUF 476,161,405,152 10 entries Q5_K_M unsloth/DeepSeek-V3.2-GGUF 481,908,502,720 10 entries UD-Q5_K_XL unsloth/DeepSeek-V3.2-GGUF 551,313,406,528 12 entries Q6_K unsloth/DeepSeek-V3.2-GGUF 573,977,459,200 12 entries UD-Q6_K_XL unsloth/DeepSeek-V3.2-GGUF 713,286,531,616 15 entries Q8_0 unsloth/DeepSeek-V3.2-GGUF 780,234,996,736 17 entries UD-Q8_K_XL unsloth/DeepSeek-V3.2-GGUF 1,342,273,065,376 30 entries BF16 - Hidden size
- KV heads
- KV latent rank (MLA)
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- RoPE key size (MLA)
- Shared experts
- Task
More from DeepSeek
- DeepSeek deepseek-coder-1.3b-instruct
- DeepSeek deepseek-coder-6.7b-base
- DeepSeek deepseek-coder-6.7b-instruct
- DeepSeek deepseek-coder-7b-instruct-v1.5
- DeepSeek DeepSeek-Coder-V2-Lite-Instruct
- DeepSeek deepseek-moe-16b-base
- DeepSeek deepseek-moe-16b-chat
- DeepSeek DeepSeek-R1
- DeepSeek DeepSeek-R1-0528
- DeepSeek DeepSeek-R1-0528-Qwen3-8B
- DeepSeek DeepSeek-R1-Distill-Llama-8B
- DeepSeek DeepSeek-R1-Distill-Llama-70B