Will it run? / mixtral 8X22B / Mac mini M4 (16GB)

Can the Mac mini M4 (16GB) run mixtral 8X22B?

Won't fit No. mixtral 8X22B needs about 81.5 GB of memory, and the Mac mini M4 (16GB) can give a model about 10.7 GB. You'd need a machine with more memory, or a smaller model.

–estimated tokens/sec
81.5 GBmemory needed
10.7 GBavailable to the model
120 GB/smemory bandwidth

Check the Mac mini M4 (16GB) price →

How we got this number

Each generated token reads the whole model from memory once: 80 GB. The Mac mini M4 (16GB) moves 120 GB/s, so the ceiling is 1.5 tokens/sec. Real machines reach a fraction of that ceiling; we use 80%, calibrated against a measured Mac run. Send us your real numbers and we'll replace the estimate.

Faster machines for mixtral 8X22B

Mac Studio M5 Ultra (256GB)12 tok/s$9,499Check price →
Mac Studio M5 Ultra (96GB)7.4 tok/s$5,499Check price →
NVIDIA DGX Spark (128GB)2.4 tok/sCheck price →
Ryzen AI Max+ 395 mini PC (128GB)2.2 tok/sCheck price →