Skip to content

Local AI sizer

305 models · 40 graphics chips · 21 weight formats

Size a model What this machine runs
KV cache
Context
8192
Parallel sequences

Hardware

Cards

Loading…

Share

Shortlists

Spec tables