Mini PCsWhich mini PC can run a 70B language model locally?

Mini PCs that can run a 70B model locally

Apple Mac Studio (M5 Ultra) and 8 other models have enough memory for a 70B model at 4-bit, which needs about 40GB for its weights. Apple Mac Studio (M5 Ultra) is fastest here at 1.2 TB/s of memory bandwidth.

Updated · How we chose: At least 64GB of memory; fastest memory first.

Matching models (9)

  1. 1Apple Mac Studio (M5 Ultra)Apple · Mac Studio M5 UltraM5 UltraMaximum memory 512GBMemory bandwidth 1.2 TB/s
  2. 2Apple Mac Studio (M5 Max)Apple · Mac Studio M5 MaxM5 MaxMaximum memory 128GBMemory bandwidth 614 GB/s
  3. 3Apple Mac mini (M5 Pro)Apple · Mac mini M5 ProM5 ProMaximum memory 64GBMemory bandwidth 307 GB/s
  4. 4Beelink GTR9 ProBeelink · GTR9 ProRyzen AI Max+ 395Maximum memory 128GBMemory bandwidth 256 GB/sTotal AI 126 TOPS
  5. 5Bosgame M5 AI Mini DesktopBosgame · M5Ryzen AI Max+ 395Maximum memory 128GBMemory bandwidth 256 GB/sTotal AI 126 TOPS
Show 4 more
  1. 6GMKtec EVO-X2GMKtec · EVO-X2Ryzen AI Max+ 395Maximum memory 128GBMemory bandwidth 256 GB/s
  2. 7Minisforum MS-S1 MAXMinisforum · MS-S1 MAXRyzen AI Max+ 395Maximum memory 128GBMemory bandwidth 256 GB/sTotal AI 126 TOPS
  3. 8Beelink SER8 (Ryzen 7 8845HS)Beelink · SER8 8845HSRyzen 7 8845HSMaximum memory 256GBMemory bandwidth 90 GB/sUpgradeable RAM
  4. 9Minisforum AI X1 Pro-370Minisforum · AI X1 Pro-370Ryzen AI 9 HX 370Maximum memory 128GBMemory bandwidth 90 GB/sTotal AI 80 TOPSUpgradeable RAM

Key findings

  • 9 verified models qualify, from Apple, Beelink, Bosgame, GMKtec, Minisforum.
  • Maximum memory: Apple Mac Studio (M5 Ultra) leads at 512GB. Across these 9 models it ranges from 64GB to 512GB (median 128GB).
  • Memory bandwidth: Apple Mac Studio (M5 Ultra) leads at 1200 GB/s. Across these 9 models it ranges from 90 GB/s to 1200 GB/s (median 256 GB/s).
  • Total AI: Beelink GTR9 Pro leads at 126 TOPS. Across these 4 models it ranges from 80 TOPS to 126 TOPS (median 126 TOPS).
  • Weight: Apple Mac mini (M5 Pro) leads at 730 g. Across these 7 models it ranges from 730 g to 3,600 g (median 2,339 g).
Mini PCs that can run a 70B model locally
ModelProcessorMemory (GB)Bandwidth (GB/s)TOPS (NPU / total)USB4 · LANSource
Apple Mac Studio (M5 Ultra)Apple · Mac Studio M5 Ultra
M5 Ultra30-core CPU96 / 256 / 512Unified memory1200— / —6 × USB410GbEsupport.apple.com
Apple Mac Studio (M5 Max)Apple · Mac Studio M5 Max
M5 Max18-core CPU36 / 48 / 64 / 128Unified memory614— / —4 × USB410GbEsupport.apple.com
Apple Mac mini (M5 Pro)Apple · Mac mini M5 Pro
M5 Pro15-core CPU24 / 48 / 64Unified memory307— / —3 × USB42.5GbE (10GbE option)support.apple.com
Beelink GTR9 ProBeelink · GTR9 Pro
Ryzen AI Max+ 39516 cores / 32 threads128LPDDR5X-8000 · soldered25650 / 1262 × USB42× 10GbEbee-link.com
Ryzen AI Max+ 39516 cores / 32 threads96 / 128LPDDR5X-800025650 / 1262 × USB42.5GbEbosgame.com
GMKtec EVO-X2GMKtec · EVO-X2
Ryzen AI Max+ 39516 cores / 32 threads64 / 128LPDDR5X-800025650 / —AMD figureUSB41× 2.5GbEgmktec.com
Minisforum MS-S1 MAXMinisforum · MS-S1 MAX
Ryzen AI Max+ 39516 cores / 32 threads128LPDDR5X-800025650 / 1264 × USB42× 10GbEstore.minisforum.com
Beelink SER8 (Ryzen 7 8845HS)Beelink · SER8 8845HS
Ryzen 7 8845HS8 cores / 16 threads24 / 32 / 64DDR5 SO-DIMM-5600 · upgradeable slots · max 256GB9016 / —USB42.5GbEbee-link.com
Minisforum AI X1 Pro-370Minisforum · AI X1 Pro-370
Ryzen AI 9 HX 37012 cores / 24 threads—DDR5 SO-DIMM-5600 · upgradeable slots · max 128GB9050 / 80AMD figure2 × USB42× 2.5GbEstore.minisforum.com

Only models whose specs agree across sources are included.

Model by model

Apple Mac Studio (M5 Ultra)

The Apple Mac Studio (M5 Ultra) (Mac Studio M5 Ultra) is an Apple mini PC with an Apple M5 Ultra (30 cores). It comes with 96GB / 256GB / 512GB of unified memory, with 1.2 TB/s of memory bandwidth as the brand states. That is enough to hold a 70B language model at 4-bit. It has 6 USB4/Thunderbolt ports and 10GbE Ethernet. It weighs 3,600 g. Specs from support.apple.com, checked 2026-11-19.

Apple Mac Studio (M5 Max)

The Apple Mac Studio (M5 Max) (Mac Studio M5 Max) is an Apple mini PC with an Apple M5 Max (18 cores). It comes with 36GB / 48GB / 64GB / 128GB of unified memory, with 614 GB/s of memory bandwidth as the brand states. That is enough to hold a 70B language model at 4-bit. It has 4 USB4/Thunderbolt ports and 10GbE Ethernet. It weighs 2,700 g. Specs from support.apple.com, checked 2026-11-19.

Apple Mac mini (M5 Pro)

The Apple Mac mini (M5 Pro) (Mac mini M5 Pro) is an Apple mini PC with an Apple M5 Pro (15 cores). It comes with 24GB / 48GB / 64GB of unified memory, with 307 GB/s of memory bandwidth as the brand states. That is enough to hold a 70B language model at 4-bit. It has 3 USB4/Thunderbolt ports and 2.5GbE (10GbE option) Ethernet. It weighs 730 g. Specs from support.apple.com, checked 2026-11-19.

Bosgame M5 AI Mini Desktop

The Bosgame M5 AI Mini Desktop (M5) is a Bosgame mini PC with an AMD Ryzen AI Max+ 395 (16 cores, 32 threads). It comes with 96GB / 128GB of LPDDR5X-8000 memory, which works out to about 256 GB/s of theoretical bandwidth. That is enough to hold a 70B language model at 4-bit. The NPU is rated at 50 TOPS and the whole chip at 126 TOPS. It has 2 USB4/Thunderbolt ports and 2.5GbE Ethernet. Specs from bosgame.com, checked 2026-11-19.

GMKtec EVO-X2

The GMKtec EVO-X2 (EVO-X2) is a GMKtec mini PC with an AMD Ryzen AI Max+ 395 (16 cores, 32 threads). It comes with 64GB / 128GB of LPDDR5X-8000 memory, which works out to about 256 GB/s of theoretical bandwidth. That is enough to hold a 70B language model at 4-bit. The NPU is rated at 50 TOPS (AMD figure). It has USB4 and 1× 2.5GbE Ethernet. Specs from gmktec.com, checked 2026-11-19.

Minisforum MS-S1 MAX

The Minisforum MS-S1 MAX (MS-S1 MAX) is a Minisforum mini PC with an AMD Ryzen AI Max+ 395 (16 cores, 32 threads). It comes with 128GB of LPDDR5X-8000 memory, which works out to about 256 GB/s of theoretical bandwidth. That is enough to hold a 70B language model at 4-bit. The NPU is rated at 50 TOPS and the whole chip at 126 TOPS. It has 4 USB4/Thunderbolt ports and 2× 10GbE Ethernet. It weighs 2,800 g. Specs from store.minisforum.com, checked 2026-11-19.

Minisforum AI X1 Pro-370

The Minisforum AI X1 Pro-370 (AI X1 Pro-370) is a Minisforum mini PC with an AMD Ryzen AI 9 HX 370 (12 cores, 24 threads). It comes with up to 128GB of DDR5 SO-DIMM-5600 memory in upgradeable slots, which works out to about 90 GB/s of theoretical bandwidth. That is enough to hold a 70B language model at 4-bit. The NPU is rated at 50 TOPS (AMD figure) and the whole chip at 80 TOPS. It has 2 USB4/Thunderbolt ports and 2× 2.5GbE Ethernet, plus OCuLink for an external GPU. It weighs 1,500 g. Specs from store.minisforum.com, checked 2026-11-19.

How we compared

At least 64GB of memory; fastest memory first. We compared 9 models using verified figures only. Each spec comes from the brand's official page or an independent lab test and links to its source in the table above. Models whose sources disagree are left out until the figure is confirmed.

Where to buy

Sources

  1. Apple Mac Studio (M5 Ultra) (Mac Studio M5 Ultra): support.apple.com, checked 2026-11-19
  2. Apple Mac Studio (M5 Max) (Mac Studio M5 Max): support.apple.com, checked 2026-11-19
  3. Apple Mac mini (M5 Pro) (Mac mini M5 Pro): support.apple.com, checked 2026-11-19
  4. Beelink GTR9 Pro (GTR9 Pro): bee-link.com, checked 2026-11-19
  5. Bosgame M5 AI Mini Desktop (M5): bosgame.com, checked 2026-11-19
  6. GMKtec EVO-X2 (EVO-X2): gmktec.com, checked 2026-11-19
  7. Minisforum MS-S1 MAX (MS-S1 MAX): store.minisforum.com, checked 2026-11-19
  8. Beelink SER8 (Ryzen 7 8845HS) (SER8 8845HS): bee-link.com, checked 2026-11-19
  9. Minisforum AI X1 Pro-370 (AI X1 Pro-370): store.minisforum.com, checked 2026-11-19

Questions

Is 64GB enough for a 70B model?
At 4-bit, yes: the weights take about 40GB, leaving room for the context and the operating system. At 8-bit a 70B model needs about 75GB.
Does an NPU help with large language models?
Not much today. Most local LLM tools run on the integrated GPU, so memory size and bandwidth matter more than NPU TOPS.

Related comparisons