Skip to content
H2oai

H2ogpt 4096 Llama2 70B Chat

Maker’s page
Check price at Amazon for h2oai h2ogpt-4096-llama2-70b-chat (affiliate link, opens in new tab)
Weights at 16-bit
138 GB
Weights at 8-bit (Q8_0)
73 GB
Weights at 4-bit (Q4_K_M)
42 GB
Smallest card at 4-bit
RTX 6000 Ada Generation · 48 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from h2oai