Skip to content
HuggingFaceTB

SmolLM3 3B

Maker’s page
Check price at Amazon for HuggingFaceTB SmolLM3-3B (affiliate link, opens in new tab)
Weights at 16-bit
6.2 GB
Weights at 8-bit (Q8_0)
3.3 GB
Weights at 4-bit (Q4_K_M)
1.9 GB
Smallest card at 4-bit
Intel Arc A380 · 6 GB
Parameters
Layers
KV heads
Context
Licence

Specs

Attention heads
Context
Downloads (30 days)
GGUF downloads
repobytesfilesquant
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,125,355,3281 entriesIQ2_M
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,253,302,0801 entriesQ2_K
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,267,666,7521 entriesIQ3_XXS
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,316,917,0561 entriesQ2_K_L
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,371,414,3361 entriesIQ3_XS
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,432,313,6641 entriesQ3_K_S
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,469,357,8881 entriesIQ3_M
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,571,069,7601 entriesQ3_K_M
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,690,214,2081 entriesQ3_K_L
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,723,834,1761 entriesIQ4_XS
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,753,829,1841 entriesQ3_K_XL
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,810,538,3041 entriesIQ4_NL
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,811,455,8081 entriesQ4_0
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,817,616,1921 entriesQ4_K_S
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,915,305,7921 entriesQ4_K_M
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,978,920,7681 entriesQ4_K_L
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF1,981,587,2641 entriesQ4_1
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF2,157,354,8161 entriesQ5_K_S
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF2,213,756,7361 entriesQ5_K_M
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF2,277,371,7121 entriesQ5_K_L
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF2,530,860,8641 entriesQ6_K
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF2,594,475,8401 entriesQ6_K_L
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF3,275,575,1041 entriesQ8_0
bartowski/HuggingFaceTB_SmolLM3-3B-GGUF6,158,339,6161 entriesBF16
Head size
Hidden size
KV heads
Layers
Licence
Parameters
Parameters by type
Publisher
Task

More from HuggingFaceTB