Moonshotai
Moonlight 16B A3B Instruct
Check price at Amazon for moonshotai Moonlight-16B-A3B-Instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 32 GB
- Weights at 8-bit (Q8_0)
- 17 GB
- Weights at 4-bit (Q4_K_M)
- 9.7 GB
- Smallest card at 4-bit
- Intel Arc B570 · 10 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- Experts
- Experts per token
- Hidden size
- KV heads
- KV latent rank (MLA)
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- RoPE key size (MLA)
- Shared experts
- Task