Will it run? / Llama 3.2 Vision 90B / Mac mini M6 (16GB)

Can the Mac mini M6 (16GB) run Llama 3.2 Vision 90B?

Won't fit No. Llama 3.2 Vision 90B needs about 56.5 GB of memory, and the Mac mini M6 (16GB) can give a model about 10.7 GB. You'd need a machine with more memory, or a smaller model.

–estimated tokens/sec
56.5 GBmemory needed
10.7 GBavailable to the model
170 GB/smemory bandwidth

Check the Mac mini M6 (16GB) price →

How we got this number

Each generated token reads the whole model from memory once: 55 GB. The Mac mini M6 (16GB) moves 170 GB/s, so the ceiling is 3.1 tokens/sec. Real machines reach a fraction of that ceiling; we use 80%, calibrated against a measured Mac run. Send us your real numbers and we'll replace the estimate.

Faster machines for Llama 3.2 Vision 90B

Mac Studio M5 Ultra (96GB)18 tok/s$5,499Check price →
Mac Studio M5 Ultra (256GB)18 tok/s$9,499Check price →
Mac Studio M5 Max (40-core GPU, 64GB)5.4 tok/s$3,799Check price →
NVIDIA DGX Spark (128GB)3.5 tok/sCheck price →