Microsoft
Phi 4
- Weights at 16-bit
- 28 GB
- Weights at 8-bit (Q8_0)
- 15 GB
- Weights at 4-bit (Q4_K_M)
- 8.5 GB
- Smallest card at 4-bit
- Intel Arc B570 · 10 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Family
- GGUF downloads
-
repo bytes files quant bartowski/phi-4-GGUF 4,485,317,056 1 entries IQ2_XS bartowski/phi-4-GGUF 4,731,548,096 1 entries IQ2_S bartowski/phi-4-GGUF 5,110,428,096 1 entries IQ2_M bartowski/phi-4-GGUF 5,547,348,416 1 entries Q2_K bartowski/phi-4-GGUF 6,049,108,416 1 entries Q2_K_L bartowski/phi-4-GGUF 6,246,699,456 1 entries IQ3_XS bartowski/phi-4-GGUF 6,504,747,456 1 entries Q3_K_S bartowski/phi-4-GGUF 6,913,835,456 1 entries IQ3_M bartowski/phi-4-GGUF 7,363,269,056 1 entries Q3_K_M bartowski/phi-4-GGUF 7,930,155,456 1 entries Q3_K_L bartowski/phi-4-GGUF 7,941,378,496 1 entries IQ4_XS bartowski/phi-4-GGUF 8,379,732,416 1 entries Q3_K_XL bartowski/phi-4-GGUF 8,383,418,816 1 entries IQ4_NL bartowski/phi-4-GGUF 8,412,090,816 1 entries Q4_0 bartowski/phi-4-GGUF 8,440,762,816 1 entries Q4_K_S bartowski/phi-4-GGUF 9,053,114,816 1 entries Q4_K_M bartowski/phi-4-GGUF 9,267,499,456 1 entries Q4_1 bartowski/phi-4-GGUF 9,434,452,416 1 entries Q4_K_L bartowski/phi-4-GGUF 10,151,580,096 1 entries Q5_K_S bartowski/phi-4-GGUF 10,604,188,096 1 entries Q5_K_M bartowski/phi-4-GGUF 10,921,300,416 1 entries Q5_K_L bartowski/phi-4-GGUF 12,030,251,456 1 entries Q6_K bartowski/phi-4-GGUF 12,279,124,416 1 entries Q6_K_L bartowski/phi-4-GGUF 15,580,500,416 1 entries Q8_0 bartowski/phi-4-GGUF 29,323,399,616 1 entries F16 bartowski/phi-4-GGUF 58,641,584,544 2 entries F32 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Released
- Task
More from Microsoft
- Microsoft maira-2
- Microsoft phi-1_5
- Microsoft phi-2
- Microsoft Phi-3 Medium 4K Instruct
- Microsoft Phi-3 Mini 4K Instruct
- Microsoft Phi-3-mini-128k-instruct
- Microsoft Phi-3-vision-128k-instruct
- Microsoft Phi-3.5-mini-instruct
- Microsoft Phi-3.5-MoE-instruct
- Microsoft Phi-4 Mini Instruct
- Microsoft Phi-4-mini-reasoning
- Microsoft Phi-4-reasoning