Skip to content
DeepSeek

DeepSeek R1 Distill Qwen 7B

Maker’s page
Check price at Amazon for DeepSeek DeepSeek-R1-Distill-Qwen-7B (affiliate link, opens in new tab)
Weights at 16-bit
15 GB
Weights at 8-bit (Q8_0)
8.1 GB
Weights at 4-bit (Q4_K_M)
4.6 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF2,780,342,2401 entriesIQ2_M
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF3,015,940,0641 entriesQ2_K
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF3,346,255,8401 entriesIQ3_XS
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF3,492,368,3521 entriesQ3_K_S
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF3,548,164,0641 entriesQ2_K_L
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF3,574,011,8721 entriesIQ3_M
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF3,808,391,1361 entriesQ3_K_M
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF4,088,459,2321 entriesQ3_K_L
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF4,218,472,4161 entriesIQ4_XS
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF4,437,813,2161 entriesIQ4_NL
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF4,444,121,0561 entriesQ4_0
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF4,457,768,9281 entriesQ4_K_S
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF4,565,331,9361 entriesQ3_K_XL
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF4,683,073,5041 entriesQ4_K_M
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF4,873,283,5521 entriesQ4_1
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF5,087,563,7441 entriesQ4_K_L
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF5,315,176,4161 entriesQ5_K_S
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF5,444,831,2001 entriesQ5_K_M
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF5,781,196,7681 entriesQ5_K_L
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF6,254,198,7521 entriesQ6_K
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF6,518,181,8561 entriesQ6_K_L
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF8,098,525,1521 entriesQ8_0
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF15,237,853,1521 entriesF16
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF30,468,419,2641 entriesF32
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More DeepSeek-R1 Distill

Across the range 7 models by family