Skip to content
Microsoft

Phi-3 Medium 4K Instruct

Maker’s page
Check price at Amazon for Microsoft Phi-3 Medium 4K Instruct (affiliate link, opens in new tab)
Weights at 16-bit
28 GB
Weights at 8-bit (Q8_0)
15 GB
Weights at 4-bit (Q4_K_M)
8.5 GB
Smallest card at 4-bit
Intel Arc B570 · 10 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/Phi-3-medium-4k-instruct-GGUF4,717,006,2081 entriesIQ2_M
bartowski/Phi-3-medium-4k-instruct-GGUF5,143,000,4481 entriesQ2_K
bartowski/Phi-3-medium-4k-instruct-GGUF5,303,320,4481 entriesQ2_K_L
bartowski/Phi-3-medium-4k-instruct-GGUF5,806,841,7281 entriesIQ3_XS
bartowski/Phi-3-medium-4k-instruct-GGUF6,064,889,7281 entriesQ3_K_S
bartowski/Phi-3-medium-4k-instruct-GGUF6,473,977,7281 entriesIQ3_M
bartowski/Phi-3-medium-4k-instruct-GGUF6,923,411,3281 entriesQ3_K_M
bartowski/Phi-3-medium-4k-instruct-GGUF7,466,011,0081 entriesIQ4_XS
bartowski/Phi-3-medium-4k-instruct-GGUF7,490,297,7281 entriesQ3_K_L
bartowski/Phi-3-medium-4k-instruct-GGUF7,633,944,4481 entriesQ3_K_XL
bartowski/Phi-3-medium-4k-instruct-GGUF7,954,469,2481 entriesQ4_K_S
bartowski/Phi-3-medium-4k-instruct-GGUF8,566,821,2481 entriesQ4_K_M
bartowski/Phi-3-medium-4k-instruct-GGUF8,688,664,4481 entriesQ4_K_L
bartowski/Phi-3-medium-4k-instruct-GGUF9,621,582,2081 entriesQ5_K_S
bartowski/Phi-3-medium-4k-instruct-GGUF10,074,190,2081 entriesQ5_K_M
bartowski/Phi-3-medium-4k-instruct-GGUF10,175,512,4481 entriesQ5_K_L
bartowski/Phi-3-medium-4k-instruct-GGUF11,453,817,7281 entriesQ6_K
bartowski/Phi-3-medium-4k-instruct-GGUF11,533,336,4481 entriesQ6_K_L
bartowski/Phi-3-medium-4k-instruct-GGUF14,834,712,4481 entriesQ8_0
bartowski/Phi-3-medium-4k-instruct-GGUF55,841,693,5042 entriesF32
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Sliding window
Task

More from Microsoft

Across the range 4 models by family