Can I run lfm 2.5 8B (A1B) on a Mac?

lfm 2.5 8B (A1B) needs about 6.7 GB of memory. It fits on 15 of the 15 machines we track. The cheapest current machine that runs it at a comfortable 10+ tokens/sec is the Mac mini M6 (16GB) ($899).

How much memory does lfm 2.5 8B (A1B) need?

About 6.7 GB: 5.2 GB for the 4-bit model plus room for context.

Can I run lfm 2.5 8B (A1B) locally? Speed on every Mac & mini PC

Machine	Memory	Fits?	Tokens/sec	From
Mac mini M5 Pro (24GB)	24 GB	Yes	120+	$1,699	Check price →
Mac mini M5 Pro (64GB)	64 GB	Yes	120+		Check price →
Mac Studio M5 Max (40-core GPU, 64GB)	64 GB	Yes	120+	$3,799	Check price →
Mac Studio M5 Ultra (96GB)	96 GB	Yes	120+	$5,499	Check price →
Mac Studio M5 Ultra (256GB)	256 GB	Yes	120+	$9,499	Check price →
Mac mini M4 Pro (64GB) older	64 GB	Yes	120+		Check price →
Ryzen AI Max+ 395 mini PC (128GB)	128 GB	Yes	120+		Check price →
NVIDIA DGX Spark (128GB)	128 GB	Yes	120+		Check price →
Mac mini M6 (16GB)	16 GB	Yes	111	$899	Check price →
Mac mini M6 (32GB)	32 GB	Yes	111		Check price →
Mac mini M4 (16GB) older	16 GB	Yes	78		Check price →
Mac mini M2 (16GB) older	16 GB	Yes	65		Check price →
Beelink SER7 (Ryzen 7 7840HS, 32GB)	32 GB	Yes	44		Check price →
Minisforum UM790 Pro (Ryzen 9 7940HS, 32GB)	32 GB	Yes	44		Check price →
GEEKOM A6 (Ryzen 7 6800H, 32GB)	32 GB	Yes	38		Check price →

This is a mixture-of-experts model: it only reads part of itself for each token, so it runs much faster than its size suggests, but the whole file still has to fit in memory. Around 10 tokens/sec reads comfortably; under 5 feels slow. How we estimate.

Embed this table

Free for blogs, READMEs and model cards. Updates automatically.

<iframe src="https://vsmacs.com/embed/lfm2-5-8b-a1b" width="100%" height="420" style="border:0" loading="lazy" title="lfm 2.5 8B (A1B) speed by machine"></iframe>