DeepSeek
DeepSeek R1 Distill Qwen 14B
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Qwen-14B (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 30 GB
- Weights at 8-bit (Q8_0)
- 16 GB
- Weights at 4-bit (Q4_K_M)
- 9.0 GB
- Smallest card at 4-bit
- Intel Arc B570 · 10 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 4,704,574,880 1 entries IQ2_XS bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 5,003,726,240 1 entries IQ2_S bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 5,356,146,080 1 entries IQ2_M bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 5,770,497,440 1 entries Q2_K bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 6,383,361,440 1 entries IQ3_XS bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 6,530,817,440 1 entries Q2_K_L bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 6,659,595,680 1 entries Q3_K_S bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 6,916,537,760 1 entries IQ3_M bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 7,339,204,000 1 entries Q3_K_M bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 7,924,768,160 1 entries Q3_K_L bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 8,119,840,160 1 entries IQ4_XS bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 8,544,267,680 1 entries Q4_0 bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 8,549,182,880 1 entries IQ4_NL bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 8,573,431,200 1 entries Q4_K_S bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 8,606,014,880 1 entries Q3_K_XL bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 8,988,110,240 1 entries Q4_K_M bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 9,392,139,680 1 entries Q4_1 bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 9,565,953,440 1 entries Q4_K_L bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 10,266,553,760 1 entries Q5_K_S bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 10,508,873,120 1 entries Q5_K_M bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 10,989,395,360 1 entries Q5_K_L bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 12,124,683,680 1 entries Q6_K bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 12,501,802,400 1 entries Q6_K_L bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 15,701,597,600 1 entries Q8_0 bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 29,547,716,000 1 entries F16 bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF 59,086,101,824 2 entries F32 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task