Swiss Ai
Apertus 8B Instruct 2509
Check price at Amazon for swiss-ai Apertus-8B-Instruct-2509 (affiliate link, opens in new tab)Affiliate link
- Weights at 16-bit
- 16 GB
- Weights at 8-bit (Q8_0)
- 8.6 GB
- Weights at 4-bit (Q4_K_M)
- 4.9 GB
- Smallest card at 4-bit
- Intel Arc A380 · 6 GB
- Parameters
- Layers
- KV heads
- Context
- Licence
Specs
- Attention heads
- Context
- Downloads (30 days)
- GGUF downloads
-
repo bytes files quant unsloth/Apertus-8B-Instruct-2509-GGUF 2,230,400,256 1 entries UD-IQ1_S unsloth/Apertus-8B-Instruct-2509-GGUF 2,348,758,272 1 entries UD-IQ1_M unsloth/Apertus-8B-Instruct-2509-GGUF 2,552,247,552 1 entries UD-IQ2_XXS unsloth/Apertus-8B-Instruct-2509-GGUF 3,026,105,600 1 entries UD-IQ2_M unsloth/Apertus-8B-Instruct-2509-GGUF 3,287,889,152 1 entries Q2_K unsloth/Apertus-8B-Instruct-2509-GGUF 3,356,538,112 1 entries UD-IQ3_XXS unsloth/Apertus-8B-Instruct-2509-GGUF 3,413,718,272 1 entries Q2_K_L unsloth/Apertus-8B-Instruct-2509-GGUF 3,501,372,672 1 entries UD-Q2_K_XL unsloth/Apertus-8B-Instruct-2509-GGUF 3,679,008,000 1 entries Q3_K_S unsloth/Apertus-8B-Instruct-2509-GGUF 4,165,547,264 1 entries Q3_K_M unsloth/Apertus-8B-Instruct-2509-GGUF 4,347,770,112 1 entries UD-Q3_K_XL unsloth/Apertus-8B-Instruct-2509-GGUF 4,480,120,064 1 entries IQ4_XS unsloth/Apertus-8B-Instruct-2509-GGUF 4,694,029,568 1 entries IQ4_NL unsloth/Apertus-8B-Instruct-2509-GGUF 4,699,272,448 1 entries Q4_0 unsloth/Apertus-8B-Instruct-2509-GGUF 4,723,389,696 1 entries Q4_K_S unsloth/Apertus-8B-Instruct-2509-GGUF 5,057,885,440 1 entries Q4_K_M unsloth/Apertus-8B-Instruct-2509-GGUF 5,135,938,816 1 entries UD-Q4_K_XL unsloth/Apertus-8B-Instruct-2509-GGUF 5,147,014,400 1 entries Q4_1 unsloth/Apertus-8B-Instruct-2509-GGUF 5,616,776,448 1 entries Q5_K_S unsloth/Apertus-8B-Instruct-2509-GGUF 5,812,860,160 1 entries Q5_K_M unsloth/Apertus-8B-Instruct-2509-GGUF 5,823,968,512 1 entries UD-Q5_K_XL unsloth/Apertus-8B-Instruct-2509-GGUF 6,615,020,800 1 entries Q6_K unsloth/Apertus-8B-Instruct-2509-GGUF 7,390,082,304 1 entries UD-Q6_K_XL unsloth/Apertus-8B-Instruct-2509-GGUF 8,565,372,160 1 entries Q8_0 unsloth/Apertus-8B-Instruct-2509-GGUF 10,621,891,840 1 entries UD-Q8_K_XL unsloth/Apertus-8B-Instruct-2509-GGUF 16,115,119,072 1 entries BF16 - Head size
- Hidden size
- KV heads
- Layers
- Licence
- Parameters
- Parameters by type
- Publisher
- Task