Will it run? / mixtral 8X22B / Mac mini M6 (16GB)

Can the Mac mini M6 (16GB) run mixtral 8X22B?

Won't fit No. mixtral 8X22B needs about 81.5 GB of memory, and the Mac mini M6 (16GB) can give a model about 10.7 GB. You'd need a machine with more memory, or a smaller model.

–estimated tokens/sec
81.5 GBmemory needed
10.7 GBavailable to the model
170 GB/smemory bandwidth

Check the Mac mini M6 (16GB) price →

How we got this number

Each generated token reads the whole model from memory once: 80 GB. The Mac mini M6 (16GB) moves 170 GB/s, so the ceiling is 2.1 tokens/sec. Real machines reach a fraction of that ceiling; we use 80%, calibrated against a measured Mac run. Send us your real numbers and we'll replace the estimate.

Faster machines for mixtral 8X22B

Mac Studio M5 Ultra (256GB)12 tok/s$9,499Check price →
Mac Studio M5 Ultra (96GB)7.4 tok/s$5,499Check price →
NVIDIA DGX Spark (128GB)2.4 tok/sCheck price →
Ryzen AI Max+ 395 mini PC (128GB)2.2 tok/sCheck price →