Skip to content
Allenai

OLMoE 1B 7B 0125 Instruct

Maker’s page
Check price at Amazon for allenai OLMoE-1B-7B-0125-Instruct (affiliate link, opens in new tab)
Weights at 16-bit
14 GB
Weights at 8-bit (Q8_0)
7.4 GB
Weights at 4-bit (Q4_K_M)
4.2 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Experts
Experts per token
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from allenai