๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

David Hendrickson
@TeksEdge
CEO & Founder | PhD | Startup Advisor | @Columbia | Author Generative Software Engineering | ๐Ÿ”” Follow for AI & Vibe Coding Tips ๐Ÿ‘‡
๊ฐ€์ž… July 2023
552 ํŒ”๋กœ์ž‰ ์ค‘    12.5K ํŒฌ
Lesson learned. Same Strix Halo. Same Qwen3.8 but OS ... Windows 11 โ†’ 37.94 sec Ubuntu โ†’ 25.27 sec Thatโ€™s 33% less time just by changing the software/OS stack. Hardware Busters retested the same BOSGAME M5: ๐Ÿง  Ryzen AI Max+ 395 ๐Ÿ’พ 128GB unified memory ๐ŸŽฎ 96GB graphics allocation On Ubuntu 26.04.1, the long Qwen3.8 response finished in ๐ŸชŸ Windows โ†’ 37.94 sec ๐Ÿง Ubuntu โ†’ 25.27 sec And the first text appeared about 11 seconds sooner. The Ubuntu setup used llama.cpp with Mesa/RADV Vulkan and ROCm paths. This is a pretty big deal for anyone buying these 128GB Strix Halo boxes for Local AI. Before spending money on new hardware, keep in mind the OS/runtime stack; it may be leaving a lot of performance on the table. ๐Ÿ”— Great article from Hardware Busters in ALT. Link in ALT
๋” ๋ณด๊ธฐ