Skip to content
Meta

Llama 3.1 8B Instruct

Maker’s page
Check price at Amazon for Meta Llama 3.1 8B Instruct (affiliate link, opens in new tab)
Weights at 16-bit
16 GB
Weights at 8-bit (Q8_0)
8.5 GB
Weights at 4-bit (Q4_K_M)
4.8 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Licence

Specs

Attention heads
Downloads (30 days)
Family
GGUF downloads
repobytesfilesquant
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF2,948,285,8561 entriesIQ2_M
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF3,179,136,4161 entriesQ2_K
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF3,518,752,1601 entriesIQ3_XS
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF3,664,504,2241 entriesQ3_K_S
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF3,692,160,4161 entriesQ2_K_L
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF3,784,828,3201 entriesIQ3_M
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,018,922,9121 entriesQ3_K_M
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,321,961,3761 entriesQ3_K_L
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,447,667,6161 entriesIQ4_XS
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,661,216,6721 entriesQ4_0_4_4
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,661,216,6721 entriesQ4_0_4_8
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,661,216,6721 entriesQ4_0_8_8
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,677,993,8881 entriesIQ4_NL
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,692,673,9521 entriesQ4_K_S
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,781,630,8801 entriesQ3_K_XL
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF4,920,739,2321 entriesQ4_K_M
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF5,310,637,4721 entriesQ4_K_L
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF5,599,298,9761 entriesQ5_K_S
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF5,732,992,4161 entriesQ5_K_M
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF6,057,223,5841 entriesQ5_K_L
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF6,596,011,4241 entriesQ6_K
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF6,850,471,3281 entriesQ6_K_L
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF8,540,775,8401 entriesQ8_0
bartowski/Meta-Llama-3.1-8B-Instruct-GGUF32,128,885,8881 entriesF32
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Released
Task

More from Meta

Across the range 5 models by family