Meta
Llama 3.2 3B Instruct
Check price at Amazon for Meta Llama-3.2-3B-Instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 6.4 GB
- Weights at 8-bit (Q8_0)
- 3.4 GB
- Weights at 4-bit (Q4_K_M)
- 1.9 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
Specs
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant unsloth/Llama-3.2-3B-Instruct-GGUF 912,345,536 1 entries UD-IQ1_S unsloth/Llama-3.2-3B-Instruct-GGUF 960,416,192 1 entries UD-IQ1_M unsloth/Llama-3.2-3B-Instruct-GGUF 1,046,579,648 1 entries UD-IQ2_XXS unsloth/Llama-3.2-3B-Instruct-GGUF 1,256,262,080 1 entries UD-IQ2_M unsloth/Llama-3.2-3B-Instruct-GGUF 1,363,935,680 1 entries Q2_K unsloth/Llama-3.2-3B-Instruct-GGUF 1,363,935,680 1 entries Q2_K_L unsloth/Llama-3.2-3B-Instruct-GGUF 1,370,147,264 1 entries UD-IQ3_XXS unsloth/Llama-3.2-3B-Instruct-GGUF 1,403,380,160 1 entries UD-Q2_K_XL unsloth/Llama-3.2-3B-Instruct-GGUF 1,542,848,960 1 entries Q3_K_S unsloth/Llama-3.2-3B-Instruct-GGUF 1,687,159,232 1 entries Q3_K_M unsloth/Llama-3.2-3B-Instruct-GGUF 1,742,430,656 1 entries UD-Q3_K_XL unsloth/Llama-3.2-3B-Instruct-GGUF 1,829,110,208 1 entries IQ4_XS unsloth/Llama-3.2-3B-Instruct-GGUF 1,917,190,592 1 entries IQ4_NL unsloth/Llama-3.2-3B-Instruct-GGUF 1,921,909,184 1 entries Q4_0 unsloth/Llama-3.2-3B-Instruct-GGUF 1,928,200,640 1 entries Q4_K_S unsloth/Llama-3.2-3B-Instruct-GGUF 2,019,377,600 1 entries Q4_K_M unsloth/Llama-3.2-3B-Instruct-GGUF 2,060,886,464 1 entries UD-Q4_K_XL unsloth/Llama-3.2-3B-Instruct-GGUF 2,093,351,360 1 entries Q4_1 unsloth/Llama-3.2-3B-Instruct-GGUF 2,269,512,128 1 entries Q5_K_S unsloth/Llama-3.2-3B-Instruct-GGUF 2,322,153,920 1 entries Q5_K_M unsloth/Llama-3.2-3B-Instruct-GGUF 2,327,781,824 1 entries UD-Q5_K_XL unsloth/Llama-3.2-3B-Instruct-GGUF 2,643,853,760 1 entries Q6_K unsloth/Llama-3.2-3B-Instruct-GGUF 2,967,833,024 1 entries UD-Q6_K_XL unsloth/Llama-3.2-3B-Instruct-GGUF 3,421,898,816 1 entries Q8_0 unsloth/Llama-3.2-3B-Instruct-GGUF 4,204,153,280 1 entries UD-Q8_K_XL unsloth/Llama-3.2-3B-Instruct-GGUF 6,433,687,616 1 entries F16 unsloth/Llama-3.2-3B-Instruct-GGUF 6,433,687,744 1 entries BF16 - Licence
- Parameters
- Parameters by type
- Publisher
- Task