๐ฅ GMKtec isn't getting the 192GB Local AI market to itself. ... but this has a few interesting differences ...
CHUWI unveiled the UniBox AI495 Pro at IFA.
And they stuffed a ridiculous amount of AI hardware into 2.9 liters
Stats ๐
๐ง Ryzen AI Max+ PRO 495
โ๏ธ 16 Zen 5 cores / 32 threads
๐ฎ Radeon 8065S โ 40 CUs
๐พ 192GB LPDDR5X-8533 unified memory
๐ฎ Up to 160GB allocated as VRAM
โก 273 GB/s memory bandwidth
๐ฝ 3ร M.2 PCIe SSD slots
๐ Dual 10GbE
๐ OCuLink
โก 2ร USB4
๐ก Wi-Fi 7
CHUWI says it can run 300B-parameter models locally at 4-bit. (Same as GMKtec)
โ ๏ธ That's a capacity claim, and really no 300B TPS benchmark shown yet.
๐ But OCuLink makes this one especially interesting.
You could attach an NVIDIA GPU when you want CUDA...
OR potentially attach an AMD Radeon with 24/32/48GB VRAM and use a multi-GPU runtime to split a huge model across the 8065S + discrete Radeon.
A 48GB card could theoretically mean roughly 160GB + 48GB = 208GB of aggregate GPU model capacity. ๐คฏ
โ ๏ธ Not one unified VRAM pool ... and I would want to see this exact configuration tested.
๐ 192GB + OCuLink + dual 10GbE in 2.9L.
Now show us the price... and somebody plug a 48GB Radeon into it. ๐ฅ