Will it run? / Mistral medium 3.5 128B / Mac mini M2 (16GB)

Can the Mac mini M2 (16GB) run Mistral medium 3.5 128B?

Won't fit No. Mistral medium 3.5 128B needs about 81.5 GB of memory, and the Mac mini M2 (16GB) can give a model about 10.7 GB. You'd need a machine with more memory, or a smaller model.

–estimated tokens/sec
81.5 GBmemory needed
10.7 GBavailable to the model
100 GB/smemory bandwidth

Check the Mac mini M2 (16GB) price →

How we got this number

Each generated token reads the whole model from memory once: 80 GB. The Mac mini M2 (16GB) moves 100 GB/s, so the ceiling is 1.3 tokens/sec. Real machines reach a fraction of that ceiling; we use 80%, calibrated against a measured Mac run. Send us your real numbers and we'll replace the estimate.

Faster machines for Mistral medium 3.5 128B

Mac Studio M5 Ultra (256GB)12 tok/s$9,499Check price →
Mac Studio M5 Ultra (96GB)7.4 tok/s$5,499Check price →
NVIDIA DGX Spark (128GB)2.4 tok/sCheck price →
Ryzen AI Max+ 395 mini PC (128GB)2.2 tok/sCheck price →