Skip to content
Qwen

Qwen2 72B Instruct

Maker’s page
Check price at Amazon for Qwen (Alibaba Cloud) Qwen2-72B-Instruct (affiliate link, opens in new tab)
Weights at 16-bit
145 GB
Weights at 8-bit (Q8_0)
77 GB
Weights at 4-bit (Q4_K_M)
44 GB
Smallest card at 4-bit
RTX 6000 Ada Generation · 48 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from Qwen (Alibaba Cloud)