Skip to content
Mistral AI

Mistral Small 3 24B Instruct (2501)

Maker’s page
Check price at Amazon for Mistral AI Mistral Small 3 24B Instruct (2501) (affiliate link, opens in new tab)
Weights at 16-bit
48 GB
Weights at 8-bit (Q8_0)
26 GB
Weights at 4-bit (Q4_K_M)
15 GB
Smallest card at 4-bit
Intel Arc A770 16GB · 16 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
unsloth/Mistral-Small-24B-Instruct-2501-GGUF8,890,325,2481 entriesQ2_K
unsloth/Mistral-Small-24B-Instruct-2501-GGUF9,047,611,6481 entriesQ2_K_L
unsloth/Mistral-Small-24B-Instruct-2501-GGUF11,474,082,0481 entriesQ3_K_M
unsloth/Mistral-Small-24B-Instruct-2501-GGUF14,333,909,2481 entriesQ4_K_M
unsloth/Mistral-Small-24B-Instruct-2501-GGUF16,763,984,1281 entriesQ5_K
unsloth/Mistral-Small-24B-Instruct-2501-GGUF19,345,938,6881 entriesQ6_K
unsloth/Mistral-Small-24B-Instruct-2501-GGUF25,054,779,6481 entriesQ8_0
unsloth/Mistral-Small-24B-Instruct-2501-GGUF47,153,518,8481 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released

More from Mistral AI

Across the range 4 models by family