DeepSeek
DeepSeek R1 Distill Qwen 32B
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Qwen-32B (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 66 GB
- Weights at 8-bit (Q8_0)
- 35 GB
- Weights at 4-bit (Q4_K_M)
- 20 GB
- Smallest card at 4-bit
- GeForce RTX 3090 · 24 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 9,028,249,760 1 entries IQ2_XXS bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 9,957,550,240 1 entries IQ2_XS bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 10,387,568,800 1 entries IQ2_S bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 11,264,440,480 1 entries IQ2_M bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 12,313,098,400 1 entries Q2_K bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 13,073,418,400 1 entries Q2_K_L bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 13,705,513,120 1 entries IQ3_XS bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 14,392,330,400 1 entries Q3_K_S bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 14,810,122,400 1 entries IQ3_M bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 15,935,047,840 1 entries Q3_K_M bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 17,247,078,560 1 entries Q3_K_L bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 17,693,153,440 1 entries IQ4_XS bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 17,928,325,280 1 entries Q3_K_XL bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 18,682,173,600 1 entries IQ4_NL bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 18,711,009,440 1 entries Q4_0 bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 18,784,409,760 1 entries Q4_K_S bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 19,851,335,840 1 entries Q4_K_M bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 20,429,179,040 1 entries Q4_K_L bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 20,639,242,400 1 entries Q4_1 bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 22,638,254,240 1 entries Q5_K_S bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 23,262,156,960 1 entries Q5_K_M bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 23,742,679,200 1 entries Q5_K_L bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 26,886,154,400 1 entries Q6_K bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 27,263,273,120 1 entries Q6_K_L bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 34,820,884,352 1 entries Q8_0 bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF 65,535,969,344 2 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task