Hardware

Unified vs traditional memory architecture

AMD chipset

Name Price CPU GPU Memory Storage Display ports Extension slots Connectivity Wireless Dimensions Max TFLOPS Tokens/sec (120B Q4) Tokens / € Tokens / W Clustering
Framework Desktop €3591 AMD Ryzen™ AI Max+ 395, 3.0GHz, 16 cores AMD Radeon™ 8060S, 2.9GHz, 20 compute units 128GB LPDDR5x, 8000 MT/s 1TB, 2× NVMe PCIe 4.0 ×4 M.2 2280, max 8TB each HDMI v2.1, 2× DisplayPort v1.4 (8K@60Hz) 1× PCIe 4.0 ×4 slot (max 50GbE) RJ45 5Gbit (Realtek RTL8126), 2× USB4-C, 2× USB-A 3.2 Gen 2 WiFi 7 (AMD RZ717) 123.7×123.1×54.6mm ~50–60 FP16 12–15 0.0055–0.0075 0.10–0.14 :HELP: Either Ethernet (bad), or adding 50GbE QSFP28 PCIe adapter + cables
Bosgame M5 AI €2080 (pre-order $1699) AMD Ryzen™ AI Max+ 395, 3.0GHz, 16 cores AMD Radeon™ 8060S, 2.9GHz, 20 compute units 128GB LPDDR5x, 8000 MT/s 2TB, 2× NVMe PCIe 4.0 ×4 M.2 2280, max 8TB each HDMI v2.1, 1× DisplayPort v1.4 (8K@60Hz) RJ45 2.5Gbit, 2× USB4-C, 3× USB-A 3.2 Gen 2, 2× USB-A 2.0, SD card WiFi 7, Bluetooth 5.2 (in M.2 2230 key-E PCIe 3.0 slot) :HELP: ~50–60 FP16 12–15 0.0055–0.0075 0.10–0.14 :DEL:
GEEKOM A9 Mega AI Mini PC $3200 / €3500 (kickstarter $1899) AMD Ryzen™ AI Max+ 395, 3.0GHz, 16 cores AMD Radeon™ 8060S, 2.9GHz, 20 compute units 128GB LPDDR5x, 8000 MT/s 2TB, 2× NVMe PCIe 4.0 ×4 M.2 2280, max 8TB each HDMI v2.1 (8K@60Hz) 2× RJ45 2.5Gbit, 2× USB4-C (support Display Port 2.1), 2× USB-C, 3× USB-A 3.2 Gen 2, SD card WiFi 7, Bluetooth 5.4 (in M.2 2230 key-E PCIe 3.0 slot) 171×171×71mm ~50–60 FP16 12–15 0.0055–0.0075 0.10–0.14 :DEL:
GMKtec EVO-X2 €3000 AMD Ryzen™ AI Max+ 395, 3.0GHz, 16 cores AMD Radeon™ 8060S, 2.9GHz, 20 compute units 128GB LPDDR5x, 8000 MT/s 2TB, 2× NVMe PCIe 4.0 ×4 M.2 2280, max 8TB each HDMI v2.1, 1× DisplayPort v1.4 (8K@60Hz) RJ45 2.5Gbit, 2× USB4-C, 3× USB-A 3.2 Gen 2, 2× USB-A 2.0, SD card WiFi 7, Bluetooth 5.4 (in M.2 2230 key-E PCIe 3.0 slot) 193×185.8×77mm ~50–60 FP16 12–15 0.0055–0.0075 0.10–0.14 :DEL:
Beelink GTR9 Pro €3000 AMD Ryzen™ AI Max+ 395, 3.0GHz, 16 cores AMD Radeon™ 8060S, 2.9GHz, 20 compute units 128GB LPDDR5x, 8000 MT/s 2TB, 2× NVMe PCIe 4.0 ×4 M.2 2280, max 8TB each HDMI v2.1 (8K@60Hz) 2× RJ45 40Gbit, 3× USB4-C, 2× USB-A 3.2 Gen 2, 2× USB-A 2.0, SD card WiFi 7 (MT7925), Bluetooth 5.4 (in M.2 2230 key-E PCIe 3.0 slot) 180×180×90.8mm ~50–60 FP16 12–15 0.0055–0.0075 0.10–0.14 :HELP: Maybe 2×40Gbit = 10MB/s
FEVM FA-EX9 €2950 AMD Ryzen™ AI Max+ 395, 3.0GHz, 16 cores AMD Radeon™ 8060S, 2.9GHz, 20 compute units 128GB LPDDR5x, 8000 MT/s 2TB, NVMe PCIe 4.0 ×4 + x1 M.2 2280, max 8TB each HDMI v2.1, 1× DisplayPort v1.4 (8K@60Hz) Oculink 64Gb/s RJ45 2.5Gbit, 2× USB4-C, 3× USB-A 3.2 Gen 2, 2× USB-A 2.0, SD card WiFi 7 (MT7925), Bluetooth 5.3 (in M.2 2230 key-E PCIe 3.0 slot) 192×190×55mm ~50–60 FP16 12–15 0.0055–0.0075 0.10–0.14 Oculink
MS-S1 MAX €3120 AMD Ryzen™ AI Max+ 395, 3.0GHz, 16 cores AMD Radeon™ 8060S, 2.9GHz, 20 compute units 128GB LPDDR5x, 8000 MT/s 2TB, NVMe PCIe 4.0 ×4 + x1 M.2 2280, max 8TB each HDMI v2.1 (8K@60Hz) 1× PCIe 4.0 ×4 slot 2× RJ45 10Gbit (Realtek RTL8127), 2× USB4-C (40Gb/s, Display Port 2.0, PD out 15W), 2× USB4-C v2 (80Gb/s, Display Port 2.0, PD out 15W), 3× USB-A 3.2 Gen 2, 2× USB-A 2.0, SD card WiFi 7 (MT7925), Bluetooth 5.4 (in M.2 2230 key-E PCIe 3.0 slot) 192×190×55mm ~50–60 FP16 12–15 0.0055–0.0075 0.10–0.14 See above using MCX416A-CCAT Mellanox ConnectX-4 2× 50Gbit/s QSFP28 ($146)

Future

NVidia chipset:

Old-school but interesting

Software

OpenClaw

Install OpenClaw

and force that host in Apache configuration:

RequestHeader set Origin "http://localhost:18789"

Install LLama local model

Install browser support

Using OpenClaw