TinyLlama
TinyLlama 1.1B Chat v1.0
Check price at Amazon for TinyLlama TinyLlama-1.1B-Chat-v1.0 (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 2.2 GB
- Weights at 8-bit (Q8_0)
- 1.2 GB
- Weights at 4-bit (Q4_K_M)
- 0.7 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 483,116,416 1 entries Q2_K TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 500,315,520 1 entries Q3_K_S TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 550,819,200 1 entries Q3_K_M TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 592,500,096 1 entries Q3_K_L TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 637,699,456 1 entries Q4_0 TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 643,728,768 1 entries Q4_K_S TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 668,788,096 1 entries Q4_K_M TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 767,001,984 1 entries Q5_0 TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 767,001,984 1 entries Q5_K_S TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 783,017,344 1 entries Q5_K_M TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 904,385,920 1 entries Q6_K TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF 1,170,781,568 1 entries Q8_0 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Task