Skip to content
Qwen

Qwen2.5 14B Instruct

Maker’s page
Check price at Amazon for Qwen (Alibaba Cloud) Qwen2.5 14B Instruct (affiliate link, opens in new tab)
Weights at 16-bit
29 GB
Weights at 8-bit (Q8_0)
16 GB
Weights at 4-bit (Q4_K_M)
8.9 GB
Smallest card at 4-bit
Intel Arc B570 · 10 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/Qwen2.5-14B-Instruct-GGUF5,356,146,8161 entriesIQ2_M
bartowski/Qwen2.5-14B-Instruct-GGUF5,770,498,1761 entriesQ2_K
bartowski/Qwen2.5-14B-Instruct-GGUF6,383,362,1761 entriesIQ3_XS
bartowski/Qwen2.5-14B-Instruct-GGUF6,530,818,1761 entriesQ2_K_L
bartowski/Qwen2.5-14B-Instruct-GGUF6,659,596,4161 entriesQ3_K_S
bartowski/Qwen2.5-14B-Instruct-GGUF6,916,538,4961 entriesIQ3_M
bartowski/Qwen2.5-14B-Instruct-GGUF7,339,204,7361 entriesQ3_K_M
bartowski/Qwen2.5-14B-Instruct-GGUF7,924,768,8961 entriesQ3_K_L
bartowski/Qwen2.5-14B-Instruct-GGUF8,119,840,8961 entriesIQ4_XS
bartowski/Qwen2.5-14B-Instruct-GGUF8,517,726,3361 entriesQ4_0_4_4
bartowski/Qwen2.5-14B-Instruct-GGUF8,517,726,3361 entriesQ4_0_4_8
bartowski/Qwen2.5-14B-Instruct-GGUF8,517,726,3361 entriesQ4_0_8_8
bartowski/Qwen2.5-14B-Instruct-GGUF8,544,268,4161 entriesQ4_0
bartowski/Qwen2.5-14B-Instruct-GGUF8,573,431,9361 entriesQ4_K_S
bartowski/Qwen2.5-14B-Instruct-GGUF8,606,015,6161 entriesQ3_K_XL
bartowski/Qwen2.5-14B-Instruct-GGUF8,988,110,9761 entriesQ4_K_M
bartowski/Qwen2.5-14B-Instruct-GGUF9,565,954,1761 entriesQ4_K_L
bartowski/Qwen2.5-14B-Instruct-GGUF10,266,554,4961 entriesQ5_K_S
bartowski/Qwen2.5-14B-Instruct-GGUF10,508,873,8561 entriesQ5_K_M
bartowski/Qwen2.5-14B-Instruct-GGUF10,989,396,0961 entriesQ5_K_L
bartowski/Qwen2.5-14B-Instruct-GGUF12,124,684,4161 entriesQ6_K
bartowski/Qwen2.5-14B-Instruct-GGUF12,501,803,1361 entriesQ6_K_L
bartowski/Qwen2.5-14B-Instruct-GGUF15,701,598,3361 entriesQ8_0
bartowski/Qwen2.5-14B-Instruct-GGUF29,547,716,4481 entriesF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More Qwen2.5

Across the range 9 models by family