Skip to content
Qwen

Qwen2.5 32B Instruct

Maker’s page
Check price at Amazon for Qwen (Alibaba Cloud) Qwen2.5 32B Instruct (affiliate link, opens in new tab)
Weights at 16-bit
65 GB
Weights at 8-bit (Q8_0)
35 GB
Weights at 4-bit (Q4_K_M)
20 GB
Smallest card at 4-bit
GeForce RTX 3090 · 24 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/Qwen2.5-32B-Instruct-GGUF9,028,250,4961 entriesIQ2_XXS
bartowski/Qwen2.5-32B-Instruct-GGUF9,957,550,9761 entriesIQ2_XS
bartowski/Qwen2.5-32B-Instruct-GGUF10,387,569,5361 entriesIQ2_S
bartowski/Qwen2.5-32B-Instruct-GGUF11,264,441,2161 entriesIQ2_M
bartowski/Qwen2.5-32B-Instruct-GGUF12,313,099,1361 entriesQ2_K
bartowski/Qwen2.5-32B-Instruct-GGUF13,073,419,1361 entriesQ2_K_L
bartowski/Qwen2.5-32B-Instruct-GGUF13,705,513,8561 entriesIQ3_XS
bartowski/Qwen2.5-32B-Instruct-GGUF14,392,331,1361 entriesQ3_K_S
bartowski/Qwen2.5-32B-Instruct-GGUF14,810,123,1361 entriesIQ3_M
bartowski/Qwen2.5-32B-Instruct-GGUF15,935,048,5761 entriesQ3_K_M
bartowski/Qwen2.5-32B-Instruct-GGUF17,247,079,2961 entriesQ3_K_L
bartowski/Qwen2.5-32B-Instruct-GGUF17,693,154,1761 entriesIQ4_XS
bartowski/Qwen2.5-32B-Instruct-GGUF17,928,326,0161 entriesQ3_K_XL
bartowski/Qwen2.5-32B-Instruct-GGUF18,640,231,2961 entriesQ4_0_4_4
bartowski/Qwen2.5-32B-Instruct-GGUF18,640,231,2961 entriesQ4_0_4_8
bartowski/Qwen2.5-32B-Instruct-GGUF18,640,231,2961 entriesQ4_0_8_8
bartowski/Qwen2.5-32B-Instruct-GGUF18,711,010,1761 entriesQ4_0
bartowski/Qwen2.5-32B-Instruct-GGUF18,784,410,4961 entriesQ4_K_S
bartowski/Qwen2.5-32B-Instruct-GGUF19,851,336,5761 entriesQ4_K_M
bartowski/Qwen2.5-32B-Instruct-GGUF20,429,179,7761 entriesQ4_K_L
bartowski/Qwen2.5-32B-Instruct-GGUF22,638,254,9761 entriesQ5_K_S
bartowski/Qwen2.5-32B-Instruct-GGUF23,262,157,6961 entriesQ5_K_M
bartowski/Qwen2.5-32B-Instruct-GGUF23,742,679,9361 entriesQ5_K_L
bartowski/Qwen2.5-32B-Instruct-GGUF26,886,155,1361 entriesQ6_K
bartowski/Qwen2.5-32B-Instruct-GGUF27,263,273,8561 entriesQ6_K_L
bartowski/Qwen2.5-32B-Instruct-GGUF34,820,885,3761 entriesQ8_0
bartowski/Qwen2.5-32B-Instruct-GGUF65,535,970,1122 entriesF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More Qwen2.5

Across the range 9 models by family