Skip to content
Google

Gemma 3 12B IT

Maker’s page
Check price at Amazon for Google Gemma 3 12B IT (affiliate link, opens in new tab)
Weights at 16-bit
24 GB
Weights at 8-bit (Q8_0)
13 GB
Weights at 4-bit (Q4_K_M)
7.4 GB
Smallest card at 4-bit
Intel Arc A750 · 8 GB
Parameters
Layers
KV heads
Licence

Specs

Attention heads
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
unsloth/gemma-3-12b-it-GGUF3,057,668,5761 entriesUD-IQ1_S
unsloth/gemma-3-12b-it-GGUF3,249,207,7761 entriesUD-IQ1_M
unsloth/gemma-3-12b-it-GGUF3,604,238,8161 entriesUD-IQ2_XXS
unsloth/gemma-3-12b-it-GGUF4,366,371,2961 entriesUD-IQ2_M
unsloth/gemma-3-12b-it-GGUF4,768,221,5361 entriesQ2_K
unsloth/gemma-3-12b-it-GGUF4,768,221,5361 entriesQ2_K_L
unsloth/gemma-3-12b-it-GGUF4,834,206,1761 entriesUD-IQ3_XXS
unsloth/gemma-3-12b-it-GGUF4,860,535,1361 entriesUD-Q2_K_XL
unsloth/gemma-3-12b-it-GGUF5,458,315,6161 entriesQ3_K_S
unsloth/gemma-3-12b-it-GGUF6,008,818,0161 entriesQ3_K_M
unsloth/gemma-3-12b-it-GGUF6,142,818,6561 entriesUD-Q3_K_XL
unsloth/gemma-3-12b-it-GGUF6,550,964,5761 entriesIQ4_XS
unsloth/gemma-3-12b-it-GGUF6,887,164,2561 entriesIQ4_NL
unsloth/gemma-3-12b-it-GGUF6,909,282,6561 entriesQ4_0
unsloth/gemma-3-12b-it-GGUF6,935,333,2161 entriesQ4_K_S
unsloth/gemma-3-12b-it-GGUF7,300,778,3361 entriesQ4_K_M
unsloth/gemma-3-12b-it-GGUF7,432,229,2161 entriesUD-Q4_K_XL
unsloth/gemma-3-12b-it-GGUF7,559,563,6161 entriesQ4_1
unsloth/gemma-3-12b-it-GGUF8,231,962,9761 entriesQ5_K_S
unsloth/gemma-3-12b-it-GGUF8,445,036,8961 entriesQ5_K_M
unsloth/gemma-3-12b-it-GGUF8,462,578,0161 entriesUD-Q5_K_XL
unsloth/gemma-3-12b-it-GGUF9,660,811,6161 entriesQ6_K
unsloth/gemma-3-12b-it-GGUF10,556,051,9361 entriesUD-Q6_K_XL
unsloth/gemma-3-12b-it-GGUF12,510,212,5761 entriesQ8_0
unsloth/gemma-3-12b-it-GGUF14,394,193,3761 entriesUD-Q8_K_XL
unsloth/gemma-3-12b-it-GGUF23,540,151,5201 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More from Google

Across the range 5 models by family