Skip to content
TinyLlama

TinyLlama 1.1B Chat v1.0

Maker’s page
Check price at Amazon for TinyLlama TinyLlama-1.1B-Chat-v1.0 (affiliate link, opens in new tab)
Weights at 16-bit
2.2 GB
Weights at 8-bit (Q8_0)
1.2 GB
Weights at 4-bit (Q4_K_M)
0.7 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF483,116,4161 entriesQ2_K
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF500,315,5201 entriesQ3_K_S
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF550,819,2001 entriesQ3_K_M
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF592,500,0961 entriesQ3_K_L
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF637,699,4561 entriesQ4_0
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF643,728,7681 entriesQ4_K_S
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF668,788,0961 entriesQ4_K_M
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF767,001,9841 entriesQ5_0
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF767,001,9841 entriesQ5_K_S
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF783,017,3441 entriesQ5_K_M
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF904,385,9201 entriesQ6_K
TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF1,170,781,5681 entriesQ8_0
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from TinyLlama