Skip to content
Qwen

Qwen3 4B Instruct 2507

Maker’s page
Check price at Amazon for Qwen (Alibaba Cloud) Qwen3-4B-Instruct-2507 (affiliate link, opens in new tab)
Weights at 16-bit
8.0 GB
Weights at 8-bit (Q8_0)
4.3 GB
Weights at 4-bit (Q4_K_M)
2.4 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
unsloth/Qwen3-4B-Instruct-2507-GGUF1,083,149,9201 entriesUD-IQ1_S
unsloth/Qwen3-4B-Instruct-2507-GGUF1,143,484,0001 entriesUD-IQ1_M
unsloth/Qwen3-4B-Instruct-2507-GGUF1,255,345,7601 entriesUD-IQ2_XXS
unsloth/Qwen3-4B-Instruct-2507-GGUF1,530,402,4001 entriesUD-IQ2_M
unsloth/Qwen3-4B-Instruct-2507-GGUF1,669,500,0001 entriesQ2_K
unsloth/Qwen3-4B-Instruct-2507-GGUF1,669,500,0001 entriesQ2_K_L
unsloth/Qwen3-4B-Instruct-2507-GGUF1,674,376,8001 entriesUD-IQ3_XXS
unsloth/Qwen3-4B-Instruct-2507-GGUF1,695,724,6401 entriesUD-Q2_K_XL
unsloth/Qwen3-4B-Instruct-2507-GGUF1,886,997,6001 entriesQ3_K_S
unsloth/Qwen3-4B-Instruct-2507-GGUF2,075,618,4001 entriesQ3_K_M
unsloth/Qwen3-4B-Instruct-2507-GGUF2,128,385,1201 entriesUD-Q3_K_XL
unsloth/Qwen3-4B-Instruct-2507-GGUF2,270,751,8401 entriesIQ4_XS
unsloth/Qwen3-4B-Instruct-2507-GGUF2,375,773,2801 entriesQ4_0
unsloth/Qwen3-4B-Instruct-2507-GGUF2,381,343,8401 entriesIQ4_NL
unsloth/Qwen3-4B-Instruct-2507-GGUF2,383,309,9201 entriesQ4_K_S
unsloth/Qwen3-4B-Instruct-2507-GGUF2,497,281,1201 entriesQ4_K_M
unsloth/Qwen3-4B-Instruct-2507-GGUF2,546,340,9601 entriesUD-Q4_K_XL
unsloth/Qwen3-4B-Instruct-2507-GGUF2,596,629,6001 entriesQ4_1
unsloth/Qwen3-4B-Instruct-2507-GGUF2,823,711,8401 entriesQ5_K_S
unsloth/Qwen3-4B-Instruct-2507-GGUF2,889,514,0801 entriesQ5_K_M
unsloth/Qwen3-4B-Instruct-2507-GGUF2,899,221,6001 entriesUD-Q5_K_XL
unsloth/Qwen3-4B-Instruct-2507-GGUF3,306,261,6001 entriesQ6_K
unsloth/Qwen3-4B-Instruct-2507-GGUF3,658,223,2001 entriesUD-Q6_K_XL
unsloth/Qwen3-4B-Instruct-2507-GGUF4,280,405,6001 entriesQ8_0
unsloth/Qwen3-4B-Instruct-2507-GGUF5,056,700,0001 entriesUD-Q8_K_XL
unsloth/Qwen3-4B-Instruct-2507-GGUF8,051,285,3441 entriesF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from Qwen (Alibaba Cloud)