Microsoft
Phi-4 Mini Instruct
Check price at Amazon for Microsoft Phi-4 Mini Instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 7.6 GB
- Weights at 8-bit (Q8_0)
- 4.0 GB
- Weights at 4-bit (Q4_K_M)
- 2.3 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant unsloth/Phi-4-mini-instruct-GGUF 1,682,635,744 1 entries Q2_K unsloth/Phi-4-mini-instruct-GGUF 1,682,635,744 1 entries Q2_K_L unsloth/Phi-4-mini-instruct-GGUF 2,117,532,640 1 entries Q3_K_M unsloth/Phi-4-mini-instruct-GGUF 2,491,874,272 1 entries Q4_K_M unsloth/Phi-4-mini-instruct-GGUF 2,848,127,968 1 entries Q5_K_M unsloth/Phi-4-mini-instruct-GGUF 3,155,622,880 1 entries Q6_K unsloth/Phi-4-mini-instruct-GGUF 4,084,611,040 1 entries Q8_0 unsloth/Phi-4-mini-instruct-GGUF 7,680,694,240 1 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Sliding window
- Task
More from Microsoft
- Microsoft maira-2
- Microsoft phi-1_5
- Microsoft phi-2
- Microsoft Phi-3 Medium 4K Instruct
- Microsoft Phi-3 Mini 4K Instruct
- Microsoft Phi-3-mini-128k-instruct
- Microsoft Phi-3-vision-128k-instruct
- Microsoft Phi-3.5-mini-instruct
- Microsoft Phi-3.5-MoE-instruct
- Microsoft Phi-4
- Microsoft Phi-4-mini-reasoning
- Microsoft Phi-4-reasoning