Will it run? / Mistral small 22B

Can I run Mistral small 22B on a Mac or mini PC?

Mistral small 22B needs about 14.5 GB of memory. It fits on 12 of the 15 machines we track. The cheapest current machine that runs it at a comfortable 10+ tokens/sec is the Mac mini M5 Pro (24GB) ($1,699).

13 GBdownload (Q4_K_M)
~14.5 GBmemory needed
12/15machines it fits on
ollama run mistral-small:22b
MachineMemoryFits?Tokens/secFrom
Mac Studio M5 Ultra (96GB) 96 GBYes76
$5,499Check price →
Mac Studio M5 Ultra (256GB) 256 GBYes76
$9,499Check price →
Mac Studio M5 Max (40-core GPU, 64GB) 64 GBYes38
$3,799Check price →
Mac mini M5 Pro (24GB) 24 GBYes19
$1,699Check price →
Mac mini M5 Pro (64GB) 64 GBYes19
Check price →
Mac mini M4 Pro (64GB) older 64 GBYes17
Check price →
NVIDIA DGX Spark (128GB) 128 GBYes15
Check price →
Ryzen AI Max+ 395 mini PC (128GB) 128 GBYes14
Check price →
Mac mini M6 (32GB) 32 GBYes11
Check price →
Beelink SER7 (Ryzen 7 7840HS, 32GB) 32 GBYes4.1
Check price →
Minisforum UM790 Pro (Ryzen 9 7940HS, 32GB) 32 GBYes4.1
Check price →
GEEKOM A6 (Ryzen 7 6800H, 32GB) 32 GBYes3.5
Check price →
Mac mini M6 (16GB) 16 GBNo–
$899Check price →
Mac mini M4 (16GB) older 16 GBNo–
Check price →
Mac mini M2 (16GB) older 16 GBNo–
Check price →

Around 10 tokens/sec reads comfortably; under 5 feels slow. How we estimate.

Other mistral-small sizes

Mistral small 24B

Embed this table

Free for blogs, READMEs and model cards. Updates automatically.

<iframe src="https://vsmacs.com/embed/mistral-small-22b" width="100%" height="420" style="border:0" loading="lazy" title="Mistral small 22B speed by machine"></iframe>