Skip to content
Microsoft

Phi 3.5 MoE Instruct

Maker’s page
Check price at Amazon for Microsoft Phi-3.5-MoE-instruct (affiliate link, opens in new tab)
Weights at 16-bit
84 GB
Weights at 8-bit (Q8_0)
44 GB
Weights at 4-bit (Q4_K_M)
25 GB
Smallest card at 4-bit
GeForce RTX 5090 · 32 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Experts
Experts per token
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Sliding window
Task

More from Microsoft