DeepSeek
DeepSeek R1 Distill Llama 70B
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Llama-70B (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 141 GB
- Weights at 8-bit (Q8_0)
- 75 GB
- Weights at 4-bit (Q4_K_M)
- 43 GB
- Smallest card at 4-bit
- RTX 6000 Ada Generation · 48 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 15,885,222,560 1 entries UD-IQ1_S unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 17,171,563,168 1 entries UD-IQ1_M unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 19,447,628,448 1 entries UD-IQ2_XXS unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 24,368,595,616 1 entries UD-IQ2_M unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 26,375,111,328 1 entries Q2_K unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 26,621,362,848 1 entries Q2_K_L unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 26,966,737,568 1 entries UD-Q2_K_XL unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 27,655,619,232 1 entries UD-IQ3_XXS unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 30,912,053,920 1 entries Q3_K_S unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 34,267,497,120 1 entries Q3_K_M unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 34,876,474,016 1 entries UD-Q3_K_XL unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 37,935,497,888 1 entries IQ4_XS unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 40,053,621,408 1 entries IQ4_NL unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 40,116,535,968 1 entries Q4_0 unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 40,347,222,688 1 entries Q4_K_S unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 42,520,396,448 1 entries Q4_K_M unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 42,664,575,648 1 entries UD-Q4_K_XL unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 44,313,592,480 1 entries Q4_1 unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 48,657,449,632 1 entries Q5_K_S unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 49,949,819,552 1 entries Q5_K_M unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 49,973,478,048 1 entries UD-Q5_K_XL unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 57,888,146,080 2 entries Q6_K unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 61,160,063,872 2 entries UD-Q6_K_XL unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 74,975,052,416 2 entries Q8_0 unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 81,231,119,200 2 entries UD-Q8_K_XL unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 141,117,915,872 3 entries BF16 unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF 141,117,915,936 3 entries F16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task