IBM Granite
Granite 3.3 2B Instruct
Check price at Amazon for ibm-granite granite-3.3-2b-instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 5.1 GB
- Weights at 8-bit (Q8_0)
- 2.7 GB
- Weights at 4-bit (Q4_K_M)
- 1.5 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant ibm-granite/granite-3.3-2b-instruct-GGUF 978,253,088 1 entries Q2_K ibm-granite/granite-3.3-2b-instruct-GGUF 1,130,296,608 1 entries Q3_K_S ibm-granite/granite-3.3-2b-instruct-GGUF 1,251,734,816 1 entries Q3_K_M ibm-granite/granite-3.3-2b-instruct-GGUF 1,357,378,848 1 entries Q3_K_L ibm-granite/granite-3.3-2b-instruct-GGUF 1,453,389,088 1 entries Q4_0 ibm-granite/granite-3.3-2b-instruct-GGUF 1,464,399,136 1 entries Q4_K_S ibm-granite/granite-3.3-2b-instruct-GGUF 1,545,303,328 1 entries Q4_K_M ibm-granite/granite-3.3-2b-instruct-GGUF 1,605,432,608 1 entries Q4_1 ibm-granite/granite-3.3-2b-instruct-GGUF 1,757,476,128 1 entries Q5_0 ibm-granite/granite-3.3-2b-instruct-GGUF 1,757,476,128 1 entries Q5_K_S ibm-granite/granite-3.3-2b-instruct-GGUF 1,804,825,888 1 entries Q5_K_M ibm-granite/granite-3.3-2b-instruct-GGUF 1,909,519,648 1 entries Q5_1 ibm-granite/granite-3.3-2b-instruct-GGUF 2,080,568,608 1 entries Q6_K ibm-granite/granite-3.3-2b-instruct-GGUF 2,694,120,096 1 entries Q8_0 ibm-granite/granite-3.3-2b-instruct-GGUF 5,069,158,176 1 entries F16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Task
More from ibm-granite
- ibm-granite granite-3.1-2b-instruct
- ibm-granite granite-3.1-3b-a800m-instruct
- ibm-granite granite-3.1-8b-instruct
- ibm-granite granite-3.2-8b-instruct
- ibm-granite granite-3.3-8b-instruct
- ibm-granite granite-3b-code-base-2k
- ibm-granite granite-4.0-1b
- ibm-granite granite-4.0-1b-base
- ibm-granite granite-4.0-h-small
- ibm-granite granite-4.0-h-tiny
- ibm-granite granite-4.0-micro
- ibm-granite granite-4.1-3b