Mistral AI
Mistral Small 3.2 24B Instruct (2506)
Check price at Amazon for Mistral AI Mistral Small 3.2 24B Instruct (2506) (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 48 GB
- Weights at 8-bit (Q8_0)
- 26 GB
- Weights at 4-bit (Q4_K_M)
- 15 GB
- Smallest card at 4-bit
- Intel Arc A770 16GB · 16 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 5,558,570,528 1 entries UD-IQ1_S unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 6,017,322,528 1 entries UD-IQ1_M unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 6,750,916,128 1 entries UD-IQ2_XXS unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 8,243,334,688 1 entries UD-IQ2_M unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 8,890,338,848 1 entries Q2_K unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 9,047,625,248 1 entries Q2_K_L unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 9,292,156,448 1 entries UD-Q2_K_XL unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 9,409,220,128 1 entries UD-IQ3_XXS unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 10,400,288,288 1 entries Q3_K_S unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 11,474,095,648 1 entries Q3_K_M unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 11,850,886,688 1 entries UD-Q3_K_XL unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 12,779,900,448 1 entries IQ4_XS unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 13,468,028,448 1 entries IQ4_NL unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 13,494,242,848 1 entries Q4_0 unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 13,549,293,088 1 entries Q4_K_S unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 14,333,922,848 1 entries Q4_K_M unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 14,548,880,928 1 entries UD-Q4_K_XL unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 14,873,120,288 1 entries Q4_1 unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 16,304,426,528 1 entries Q5_K_S unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 16,763,997,728 1 entries Q5_K_M unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 16,788,123,168 1 entries UD-Q5_K_XL unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 19,345,952,288 1 entries Q6_K unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 20,788,399,648 1 entries UD-Q6_K_XL unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 25,054,793,248 1 entries Q8_0 unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 28,991,868,448 1 entries UD-Q8_K_XL unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF 47,153,532,160 1 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
More from Mistral AI
Across the range 4 models by family
Mistral Small 3.2Mistral AI Mistral Small 3.2 24B Instruct (2506) · 24.01 B
Mistral Small 3.2Mistral AI Mistral Small 3.2 24B Instruct (2506) · 131,072 tokens