12 verified modelsUpdated
Mini PCs for local AI: memory, bandwidth and AI TOPS
How much memory each mini PC can give a local language model, how fast that memory is, and the AI TOPS the brand states. Memory size decides which models fit; memory bandwidth decides how fast they answer. 1 more model is waiting because its sources disagree or are incomplete.
- 96GB or more shared CPU/GPU memory
- Fit a 70B model at 4-bit
- Upgradeable RAM (SO-DIMM)
| Model | Processor | Memory (GB) | Bandwidth (GB/s) | TOPS (NPU / total) | USB4 · LAN | Source |
|---|---|---|---|---|---|---|
Apple Mac Studio (M5 Ultra)Apple · Mac Studio M5 Ultra | M5 Ultra30-core CPU | 96 / 256 / 512Unified memory | 1200 | — / — | 6 × USB410GbE | support.apple.com |
Apple Mac Studio (M5 Max)Apple · Mac Studio M5 Max | M5 Max18-core CPU | 36 / 48 / 64 / 128Unified memory | 614 | — / — | 4 × USB410GbE | support.apple.com |
Apple Mac mini (M5 Pro)Apple · Mac mini M5 Pro | M5 Pro15-core CPU | 24 / 48 / 64Unified memory | 307 | — / — | 3 × USB42.5GbE (10GbE option) | support.apple.com |
Beelink GTR9 ProBeelink · GTR9 Pro | Ryzen AI Max+ 39516 cores / 32 threads | 128LPDDR5X-8000 · soldered | 256 | 50 / 126 | 2 × USB42× 10GbE | bee-link.com |
Bosgame M5 AI Mini DesktopBosgame · M5 | Ryzen AI Max+ 39516 cores / 32 threads | 96 / 128LPDDR5X-8000 | 256 | 50 / 126 | 2 × USB42.5GbE | bosgame.com |
GMKtec EVO-X2GMKtec · EVO-X2 | Ryzen AI Max+ 39516 cores / 32 threads | 64 / 128LPDDR5X-8000 | 256 | 50 / —AMD figure | USB41× 2.5GbE | gmktec.com |
Minisforum MS-S1 MAXMinisforum · MS-S1 MAX | Ryzen AI Max+ 39516 cores / 32 threads | 128LPDDR5X-8000 | 256 | 50 / 126 | 4 × USB42× 10GbE | store.minisforum.com |
Apple Mac mini (M6)Apple · Mac mini M6 | M612-core CPU | 16 / 24 / 32Unified memory | 170 | — / — | 3 × USB42.5GbE (10GbE option) | support.apple.com |
Beelink SER9 Pro (Ryzen AI 9 HX 370)Beelink · SER9 Pro HX 370 | Ryzen AI 9 HX 37012 cores / 24 threads | 32LPDDR5X-7500 · soldered | 120 | 50 / 80AMD figure | 1 × USB42.5GbE | bee-link.com |
GMKtec EVO-X1GMKtec · EVO-X1 | Ryzen AI 9 HX 37012 cores / 24 threads | 32LPDDR5X-7500 · soldered | 120 | 50 / 80 | 1 × USB42× 2.5GbE | de.gmktec.com |
Beelink SER8 (Ryzen 7 8845HS)Beelink · SER8 8845HS | Ryzen 7 8845HS8 cores / 16 threads | 24 / 32 / 64DDR5 SO-DIMM-5600 · upgradeable slots · max 256GB | 90 | 16 / — | USB42.5GbE | bee-link.com |
Minisforum AI X1 Pro-370Minisforum · AI X1 Pro-370 | Ryzen AI 9 HX 37012 cores / 24 threads | —DDR5 SO-DIMM-5600 · upgradeable slots · max 128GB | 90 | 50 / 80AMD figure | 2 × USB42× 2.5GbE | store.minisforum.com |
Apple states memory bandwidth for each Mac, and we use its figure. For other models, bandwidth is the theoretical peak: memory speed × bus width (256-bit for Ryzen AI Max+ 395, 128-bit for Ryzen AI 9 HX 370 and Ryzen 7 8845HS, per AMD). Real-world speed is lower. NPU figures marked AMD come from AMD’s processor spec where the brand gives none. A 70B model at 4-bit needs about 40GB for its weights, before context.
Questions
- How much memory do I need to run a language model locally?
- Roughly the model size at your quantization plus room for context: a 7–8B model at 4-bit needs about 5GB, a 30B model about 18GB, and a 70B model about 40GB. Verified mini PCs with enough memory for 70B at 4-bit: Apple Mac Studio (M5 Ultra), Apple Mac Studio (M5 Max), Apple Mac mini (M5 Pro), Beelink GTR9 Pro, Bosgame M5 AI Mini Desktop, GMKtec EVO-X2, Minisforum MS-S1 MAX, Beelink SER8 (Ryzen 7 8845HS), Minisforum AI X1 Pro-370.
- Why does memory bandwidth matter more than TOPS for chatbots?
- Generating each word means reading the whole model from memory, so speed is limited by bandwidth. A 256GB/s Ryzen AI Max+ 395 machine generates text roughly twice as fast as a 120GB/s Ryzen AI 9 HX 370 machine with the same model.
- What is the difference between the Ryzen AI Max+ 395 and the Ryzen AI 9 HX 370?
- Both have a 50 TOPS NPU. The AI Max+ 395 has 16 cores, a 40-CU Radeon 8060S and a 256-bit memory bus with up to 128GB; the HX 370 has 12 cores, a 16-CU Radeon 890M and a 128-bit bus.
- Can I upgrade the memory later?
- Only on models with SO-DIMM slots: Beelink SER8 (Ryzen 7 8845HS), Minisforum AI X1 Pro-370. LPDDR5X memory on Ryzen AI Max+ 395 machines is fixed at purchase, so buy the size you need.
- Why are some models missing?
- 1 more models are in our database but the brand's page does not give enough specs yet. They will be added once the figures are confirmed.