HuggingFaceTB
SmolLM3 3B
- Weights at 16-bit
- 6.2 GB
- Weights at 8-bit (Q8_0)
- 3.3 GB
- Weights at 4-bit (Q4_K_M)
- 1.9 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,125,355,328 1 entries IQ2_M bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,253,302,080 1 entries Q2_K bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,267,666,752 1 entries IQ3_XXS bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,316,917,056 1 entries Q2_K_L bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,371,414,336 1 entries IQ3_XS bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,432,313,664 1 entries Q3_K_S bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,469,357,888 1 entries IQ3_M bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,571,069,760 1 entries Q3_K_M bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,690,214,208 1 entries Q3_K_L bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,723,834,176 1 entries IQ4_XS bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,753,829,184 1 entries Q3_K_XL bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,810,538,304 1 entries IQ4_NL bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,811,455,808 1 entries Q4_0 bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,817,616,192 1 entries Q4_K_S bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,915,305,792 1 entries Q4_K_M bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,978,920,768 1 entries Q4_K_L bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 1,981,587,264 1 entries Q4_1 bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 2,157,354,816 1 entries Q5_K_S bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 2,213,756,736 1 entries Q5_K_M bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 2,277,371,712 1 entries Q5_K_L bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 2,530,860,864 1 entries Q6_K bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 2,594,475,840 1 entries Q6_K_L bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 3,275,575,104 1 entries Q8_0 bartowski/HuggingFaceTB_SmolLM3-3B-GGUF 6,158,339,616 1 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Task