DeepSeek
DeepSeek R1
- Weights at 16-bit
- 1,342 GB
- Weights at 8-bit (Q8_0)
- 713 GB
- Weights at 4-bit (Q4_K_M)
- 407 GB
- Smallest card at 4-bit
- More than one card
- Parameters
- Active parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Active parameters
- Attention heads
- Context
- Downloads (30 days)
- Experts
- Experts per token
- Family
- GGUF downloads
-
repo bytes files quant unsloth/DeepSeek-R1-GGUF 140,231,438,464 3 entries UD-IQ1_S unsloth/DeepSeek-R1-GGUF 168,916,283,648 4 entries UD-IQ1_M unsloth/DeepSeek-R1-GGUF 196,162,482,432 4 entries UD-IQ2_XXS unsloth/DeepSeek-R1-GGUF 221,253,686,944 5 entries Q2_K_XS unsloth/DeepSeek-R1-GGUF 226,601,595,040 5 entries UD-Q2_K_XL unsloth/DeepSeek-R1-GGUF 244,028,343,936 5 entries Q2_K unsloth/DeepSeek-R1-GGUF 244,245,534,336 5 entries Q2_K_L unsloth/DeepSeek-R1-GGUF 319,198,395,744 7 entries Q3_K_M unsloth/DeepSeek-R1-GGUF 404,430,187,616 9 entries Q4_K_M unsloth/DeepSeek-R1-GGUF 475,396,558,144 10 entries Q5_K_M unsloth/DeepSeek-R1-GGUF 550,798,326,880 12 entries Q6_K unsloth/DeepSeek-R1-GGUF 713,286,514,368 15 entries Q8_0 unsloth/DeepSeek-R1-GGUF 1,342,273,048,096 30 entries BF16 - Hidden size
- KV heads
- KV latent rank (MLA)
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- RoPE key size (MLA)
- Shared experts
- Task
More from DeepSeek
- DeepSeek deepseek-coder-1.3b-instruct
- DeepSeek deepseek-coder-6.7b-base
- DeepSeek deepseek-coder-6.7b-instruct
- DeepSeek deepseek-coder-7b-instruct-v1.5
- DeepSeek DeepSeek-Coder-V2-Lite-Instruct
- DeepSeek deepseek-moe-16b-base
- DeepSeek deepseek-moe-16b-chat
- DeepSeek DeepSeek-R1-0528
- DeepSeek DeepSeek-R1-0528-Qwen3-8B
- DeepSeek DeepSeek-R1-Distill-Llama-8B
- DeepSeek DeepSeek-R1-Distill-Llama-70B
- DeepSeek DeepSeek-R1-Distill-Qwen-1.5B