Skip to content
Mistral AI

Mistral Small 3.2 24B Instruct (2506)

Maker’s page
Check price at Amazon for Mistral AI Mistral Small 3.2 24B Instruct (2506) (affiliate link, opens in new tab)
Weights at 16-bit
48 GB
Weights at 8-bit (Q8_0)
26 GB
Weights at 4-bit (Q4_K_M)
15 GB
Smallest card at 4-bit
Intel Arc A770 16GB · 16 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF5,558,570,5281 entriesUD-IQ1_S
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF6,017,322,5281 entriesUD-IQ1_M
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF6,750,916,1281 entriesUD-IQ2_XXS
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF8,243,334,6881 entriesUD-IQ2_M
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF8,890,338,8481 entriesQ2_K
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF9,047,625,2481 entriesQ2_K_L
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF9,292,156,4481 entriesUD-Q2_K_XL
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF9,409,220,1281 entriesUD-IQ3_XXS
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF10,400,288,2881 entriesQ3_K_S
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF11,474,095,6481 entriesQ3_K_M
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF11,850,886,6881 entriesUD-Q3_K_XL
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF12,779,900,4481 entriesIQ4_XS
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF13,468,028,4481 entriesIQ4_NL
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF13,494,242,8481 entriesQ4_0
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF13,549,293,0881 entriesQ4_K_S
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF14,333,922,8481 entriesQ4_K_M
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF14,548,880,9281 entriesUD-Q4_K_XL
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF14,873,120,2881 entriesQ4_1
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF16,304,426,5281 entriesQ5_K_S
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF16,763,997,7281 entriesQ5_K_M
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF16,788,123,1681 entriesUD-Q5_K_XL
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF19,345,952,2881 entriesQ6_K
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF20,788,399,6481 entriesUD-Q6_K_XL
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF25,054,793,2481 entriesQ8_0
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF28,991,868,4481 entriesUD-Q8_K_XL
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF47,153,532,1601 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released

More from Mistral AI

Across the range 4 models by family