Skip to content
Mistral AI

Mistral 7B Instruct v0.3

Maker’s page
Check price at Amazon for Mistral AI Mistral 7B Instruct v0.3 (affiliate link, opens in new tab)
Weights at 16-bit
15 GB
Weights at 8-bit (Q8_0)
7.7 GB
Weights at 4-bit (Q4_K_M)
4.4 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF3,288,846,5601 entriesIQ3_M
lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF3,825,979,6161 entriesQ3_K_L
lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF4,130,066,6561 entriesIQ4_NL
lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF4,372,812,0001 entriesQ4_K_M
lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF5,136,175,3281 entriesQ5_K_M
lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF5,947,248,8641 entriesQ6_K
lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF7,702,565,0881 entriesQ8_0
lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF28,992,851,9041 entriesF32
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher

More from Mistral AI

Across the range 4 models by family