๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
๊ฐ€์ž… July 2023
549 ํŒ”๋กœ์ž‰ ์ค‘    11.2K ํŒฌ
๐Ÿ”ฅ GMKtec isn't getting the 192GB Local AI market to itself. ... but this has a few interesting differences ... CHUWI unveiled the UniBox AI495 Pro at IFA. And they stuffed a ridiculous amount of AI hardware into 2.9 liters Stats ๐Ÿ‘‡ ๐Ÿง  Ryzen AI Max+ PRO 495 โš™๏ธ 16 Zen 5 cores / 32 threads ๐ŸŽฎ Radeon 8065S โ€” 40 CUs ๐Ÿ’พ 192GB LPDDR5X-8533 unified memory ๐ŸŽฎ Up to 160GB allocated as VRAM โšก 273 GB/s memory bandwidth ๐Ÿ’ฝ 3ร— M.2 PCIe SSD slots ๐ŸŒ Dual 10GbE ๐Ÿ”Œ OCuLink โšก 2ร— USB4 ๐Ÿ“ก Wi-Fi 7 CHUWI says it can run 300B-parameter models locally at 4-bit. (Same as GMKtec) โš ๏ธ That's a capacity claim, and really no 300B TPS benchmark shown yet. ๐Ÿ‘€ But OCuLink makes this one especially interesting. You could attach an NVIDIA GPU when you want CUDA... OR potentially attach an AMD Radeon with 24/32/48GB VRAM and use a multi-GPU runtime to split a huge model across the 8065S + discrete Radeon. A 48GB card could theoretically mean roughly 160GB + 48GB = 208GB of aggregate GPU model capacity. ๐Ÿคฏ โš ๏ธ Not one unified VRAM pool ... and I would want to see this exact configuration tested. ๐Ÿ‘€ 192GB + OCuLink + dual 10GbE in 2.9L. Now show us the price... and somebody plug a 48GB Radeon into it. ๐Ÿ”ฅ
๋” ๋ณด๊ธฐ