Meta
Llama 3.2 1B Instruct
Check price at Amazon for Meta Llama-3.2-1B-Instruct (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 2.5 GB
- Weights at 8-bit (Q8_0)
- 1.3 GB
- Weights at 4-bit (Q4_K_M)
- 0.8 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
Specs
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant bartowski/Llama-3.2-1B-Instruct-GGUF 657,289,344 1 entries IQ3_M bartowski/Llama-3.2-1B-Instruct-GGUF 732,524,672 1 entries Q3_K_L bartowski/Llama-3.2-1B-Instruct-GGUF 743,141,504 1 entries IQ4_XS bartowski/Llama-3.2-1B-Instruct-GGUF 770,928,768 1 entries Q4_0_4_4 bartowski/Llama-3.2-1B-Instruct-GGUF 770,928,768 1 entries Q4_0_4_8 bartowski/Llama-3.2-1B-Instruct-GGUF 770,928,768 1 entries Q4_0_8_8 bartowski/Llama-3.2-1B-Instruct-GGUF 773,025,920 1 entries Q4_0 bartowski/Llama-3.2-1B-Instruct-GGUF 775,647,360 1 entries Q4_K_S bartowski/Llama-3.2-1B-Instruct-GGUF 796,139,648 1 entries Q3_K_XL bartowski/Llama-3.2-1B-Instruct-GGUF 807,694,464 1 entries Q4_K_M bartowski/Llama-3.2-1B-Instruct-GGUF 871,309,440 1 entries Q4_K_L bartowski/Llama-3.2-1B-Instruct-GGUF 892,563,584 1 entries Q5_K_S bartowski/Llama-3.2-1B-Instruct-GGUF 911,503,488 1 entries Q5_K_M bartowski/Llama-3.2-1B-Instruct-GGUF 975,118,464 1 entries Q5_K_L bartowski/Llama-3.2-1B-Instruct-GGUF 1,021,800,576 1 entries Q6_K bartowski/Llama-3.2-1B-Instruct-GGUF 1,085,415,552 1 entries Q6_K_L bartowski/Llama-3.2-1B-Instruct-GGUF 1,321,083,008 1 entries Q8_0 bartowski/Llama-3.2-1B-Instruct-GGUF 2,479,595,360 1 entries F16 - Licence
- Parameters
- Parameters by type
- Publisher
- Task