Skip to content
IBM Granite

Granite 3.3 2B Instruct

Maker’s page
Check price at Amazon for ibm-granite granite-3.3-2b-instruct (affiliate link, opens in new tab)
Weights at 16-bit
5.1 GB
Weights at 8-bit (Q8_0)
2.7 GB
Weights at 4-bit (Q4_K_M)
1.5 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
ibm-granite/granite-3.3-2b-instruct-GGUF978,253,0881 entriesQ2_K
ibm-granite/granite-3.3-2b-instruct-GGUF1,130,296,6081 entriesQ3_K_S
ibm-granite/granite-3.3-2b-instruct-GGUF1,251,734,8161 entriesQ3_K_M
ibm-granite/granite-3.3-2b-instruct-GGUF1,357,378,8481 entriesQ3_K_L
ibm-granite/granite-3.3-2b-instruct-GGUF1,453,389,0881 entriesQ4_0
ibm-granite/granite-3.3-2b-instruct-GGUF1,464,399,1361 entriesQ4_K_S
ibm-granite/granite-3.3-2b-instruct-GGUF1,545,303,3281 entriesQ4_K_M
ibm-granite/granite-3.3-2b-instruct-GGUF1,605,432,6081 entriesQ4_1
ibm-granite/granite-3.3-2b-instruct-GGUF1,757,476,1281 entriesQ5_0
ibm-granite/granite-3.3-2b-instruct-GGUF1,757,476,1281 entriesQ5_K_S
ibm-granite/granite-3.3-2b-instruct-GGUF1,804,825,8881 entriesQ5_K_M
ibm-granite/granite-3.3-2b-instruct-GGUF1,909,519,6481 entriesQ5_1
ibm-granite/granite-3.3-2b-instruct-GGUF2,080,568,6081 entriesQ6_K
ibm-granite/granite-3.3-2b-instruct-GGUF2,694,120,0961 entriesQ8_0
ibm-granite/granite-3.3-2b-instruct-GGUF5,069,158,1761 entriesF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from ibm-granite