Will it run? / Nemotron 3 super 120B (A12B) / Mac mini M4 (16GB)

Can the Mac mini M4 (16GB) run Nemotron 3 super 120B (A12B)?

Won't fit No. Nemotron 3 super 120B (A12B) needs about 88.5 GB of memory, and the Mac mini M4 (16GB) can give a model about 10.7 GB. You'd need a machine with more memory, or a smaller model.

–estimated tokens/sec
88.5 GBmemory needed
10.7 GBavailable to the model
120 GB/smemory bandwidth

Check the Mac mini M4 (16GB) price →

How we got this number

Each generated token reads the active part of the model from memory once: 8.7 GB. The Mac mini M4 (16GB) moves 120 GB/s, so the ceiling is 14 tokens/sec. Real machines reach a fraction of that ceiling; we use 80%, calibrated against a measured Mac run. Send us your real numbers and we'll replace the estimate.

Faster machines for Nemotron 3 super 120B (A12B)

Mac Studio M5 Ultra (256GB)63 tok/s$9,499Check price →
Mac Studio M5 Ultra (96GB)38 tok/s$5,499Check price →
NVIDIA DGX Spark (128GB)12 tok/sCheck price →
Ryzen AI Max+ 395 mini PC (128GB)11 tok/sCheck price →