Skip to content
Microsoft

Phi-4 Mini Instruct

Maker’s page
Check price at Amazon for Microsoft Phi-4 Mini Instruct (affiliate link, opens in new tab)
Weights at 16-bit
7.6 GB
Weights at 8-bit (Q8_0)
4.0 GB
Weights at 4-bit (Q4_K_M)
2.3 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
unsloth/Phi-4-mini-instruct-GGUF1,682,635,7441 entriesQ2_K
unsloth/Phi-4-mini-instruct-GGUF1,682,635,7441 entriesQ2_K_L
unsloth/Phi-4-mini-instruct-GGUF2,117,532,6401 entriesQ3_K_M
unsloth/Phi-4-mini-instruct-GGUF2,491,874,2721 entriesQ4_K_M
unsloth/Phi-4-mini-instruct-GGUF2,848,127,9681 entriesQ5_K_M
unsloth/Phi-4-mini-instruct-GGUF3,155,622,8801 entriesQ6_K
unsloth/Phi-4-mini-instruct-GGUF4,084,611,0401 entriesQ8_0
unsloth/Phi-4-mini-instruct-GGUF7,680,694,2401 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Sliding window
Task

More from Microsoft

Across the range 4 models by family