註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

kaios
@kaiostephens
founder @nipuxx, @neutralityorg | data science @uwaterloo | ambassador @Alibaba_qwen
加入 June 2012
404 正在關注    25K 粉絲
If you want to run local AI for inference, buy one of these. This is an idea I had long ago but never had the balls to bring it to fruition. Really exited with what lucebox has been cooking, really want to get my hands on one of these machines.
顯示更多
Today, we're really excited to announce that @luceboxai is partnering with @AMD to bring heterogenous consumer hardware to life. We worked really hard on this, and were able to have Lucebox (AMD Radeon AI PRO R9700 + Strix Halo) to beat one NVIDIA DGX Spark by 3.63x on DeepSeek V4 Flash Decode Speed. R9700 takes the dense path, the hot experts, the cache and the draft model. Strix Halo holds the other experts in 128gb and computes them at the same time, not after. 51.1 tok/s on the full 284B, 3.63x one DGX Spark, and $2,899 less than having two of them. More details on the machine at and full technical breakdown in the article below ⬇️
顯示更多