12 verified modelsUpdated

Mini PCs for local AI: memory, bandwidth and AI TOPS

How much memory each mini PC can give a local language model, how fast that memory is, and the AI TOPS the brand states. Memory size decides which models fit; memory bandwidth decides how fast they answer. 1 more model is waiting because its sources disagree or are incomplete.

Mini PCs for local AI: memory, bandwidth and AI TOPS: verified specifications
ModelProcessorMemory (GB)Bandwidth (GB/s)TOPS (NPU / total)USB4 · LANSource
Apple Mac Studio (M5 Ultra)Apple · Mac Studio M5 Ultra
M5 Ultra30-core CPU96 / 256 / 512Unified memory1200— / —6 × USB410GbEsupport.apple.com
Apple Mac Studio (M5 Max)Apple · Mac Studio M5 Max
M5 Max18-core CPU36 / 48 / 64 / 128Unified memory614— / —4 × USB410GbEsupport.apple.com
Apple Mac mini (M5 Pro)Apple · Mac mini M5 Pro
M5 Pro15-core CPU24 / 48 / 64Unified memory307— / —3 × USB42.5GbE (10GbE option)support.apple.com
Beelink GTR9 ProBeelink · GTR9 Pro
Ryzen AI Max+ 39516 cores / 32 threads128LPDDR5X-8000 · soldered25650 / 1262 × USB42× 10GbEbee-link.com
Ryzen AI Max+ 39516 cores / 32 threads96 / 128LPDDR5X-800025650 / 1262 × USB42.5GbEbosgame.com
GMKtec EVO-X2GMKtec · EVO-X2
Ryzen AI Max+ 39516 cores / 32 threads64 / 128LPDDR5X-800025650 / —AMD figureUSB41× 2.5GbEgmktec.com
Minisforum MS-S1 MAXMinisforum · MS-S1 MAX
Ryzen AI Max+ 39516 cores / 32 threads128LPDDR5X-800025650 / 1264 × USB42× 10GbEstore.minisforum.com
Apple Mac mini (M6)Apple · Mac mini M6
M612-core CPU16 / 24 / 32Unified memory170— / —3 × USB42.5GbE (10GbE option)support.apple.com
Beelink SER9 Pro (Ryzen AI 9 HX 370)Beelink · SER9 Pro HX 370
Ryzen AI 9 HX 37012 cores / 24 threads32LPDDR5X-7500 · soldered12050 / 80AMD figure1 × USB42.5GbEbee-link.com
GMKtec EVO-X1GMKtec · EVO-X1
Ryzen AI 9 HX 37012 cores / 24 threads32LPDDR5X-7500 · soldered12050 / 801 × USB42× 2.5GbEde.gmktec.com
Beelink SER8 (Ryzen 7 8845HS)Beelink · SER8 8845HS
Ryzen 7 8845HS8 cores / 16 threads24 / 32 / 64DDR5 SO-DIMM-5600 · upgradeable slots · max 256GB9016 / —USB42.5GbEbee-link.com
Minisforum AI X1 Pro-370Minisforum · AI X1 Pro-370
Ryzen AI 9 HX 37012 cores / 24 threads—DDR5 SO-DIMM-5600 · upgradeable slots · max 128GB9050 / 80AMD figure2 × USB42× 2.5GbEstore.minisforum.com

Apple states memory bandwidth for each Mac, and we use its figure. For other models, bandwidth is the theoretical peak: memory speed × bus width (256-bit for Ryzen AI Max+ 395, 128-bit for Ryzen AI 9 HX 370 and Ryzen 7 8845HS, per AMD). Real-world speed is lower. NPU figures marked AMD come from AMD’s processor spec where the brand gives none. A 70B model at 4-bit needs about 40GB for its weights, before context.

Questions

How much memory do I need to run a language model locally?
Roughly the model size at your quantization plus room for context: a 7–8B model at 4-bit needs about 5GB, a 30B model about 18GB, and a 70B model about 40GB. Verified mini PCs with enough memory for 70B at 4-bit: Apple Mac Studio (M5 Ultra), Apple Mac Studio (M5 Max), Apple Mac mini (M5 Pro), Beelink GTR9 Pro, Bosgame M5 AI Mini Desktop, GMKtec EVO-X2, Minisforum MS-S1 MAX, Beelink SER8 (Ryzen 7 8845HS), Minisforum AI X1 Pro-370.
Why does memory bandwidth matter more than TOPS for chatbots?
Generating each word means reading the whole model from memory, so speed is limited by bandwidth. A 256GB/s Ryzen AI Max+ 395 machine generates text roughly twice as fast as a 120GB/s Ryzen AI 9 HX 370 machine with the same model.
What is the difference between the Ryzen AI Max+ 395 and the Ryzen AI 9 HX 370?
Both have a 50 TOPS NPU. The AI Max+ 395 has 16 cores, a 40-CU Radeon 8060S and a 256-bit memory bus with up to 128GB; the HX 370 has 12 cores, a 16-CU Radeon 890M and a 128-bit bus.
Can I upgrade the memory later?
Only on models with SO-DIMM slots: Beelink SER8 (Ryzen 7 8845HS), Minisforum AI X1 Pro-370. LPDDR5X memory on Ryzen AI Max+ 395 machines is fixed at purchase, so buy the size you need.
Why are some models missing?
1 more models are in our database but the brand's page does not give enough specs yet. They will be added once the figures are confirmed.