Skip to content
DeepSeek

DeepSeek R1 Distill Qwen 32B

Maker’s page
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Qwen-32B (affiliate link, opens in new tab)
Weights at 16-bit
66 GB
Weights at 8-bit (Q8_0)
35 GB
Weights at 4-bit (Q4_K_M)
20 GB
Smallest card at 4-bit
GeForce RTX 3090 · 24 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF9,028,249,7601 entriesIQ2_XXS
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF9,957,550,2401 entriesIQ2_XS
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF10,387,568,8001 entriesIQ2_S
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF11,264,440,4801 entriesIQ2_M
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF12,313,098,4001 entriesQ2_K
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF13,073,418,4001 entriesQ2_K_L
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF13,705,513,1201 entriesIQ3_XS
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF14,392,330,4001 entriesQ3_K_S
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF14,810,122,4001 entriesIQ3_M
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF15,935,047,8401 entriesQ3_K_M
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF17,247,078,5601 entriesQ3_K_L
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF17,693,153,4401 entriesIQ4_XS
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF17,928,325,2801 entriesQ3_K_XL
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF18,682,173,6001 entriesIQ4_NL
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF18,711,009,4401 entriesQ4_0
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF18,784,409,7601 entriesQ4_K_S
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF19,851,335,8401 entriesQ4_K_M
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF20,429,179,0401 entriesQ4_K_L
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF20,639,242,4001 entriesQ4_1
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF22,638,254,2401 entriesQ5_K_S
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF23,262,156,9601 entriesQ5_K_M
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF23,742,679,2001 entriesQ5_K_L
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF26,886,154,4001 entriesQ6_K
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF27,263,273,1201 entriesQ6_K_L
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF34,820,884,3521 entriesQ8_0
bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF65,535,969,3442 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More DeepSeek-R1 Distill

Across the range 7 models by family