가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Bleys Goodson
@bleysg
Helping people engineer the future. The core metric is task/GJ (gigajoule) and GJ/humanity.
가입 March 2009
2K 팔로잉 중    3.3K 팬
M5 Ultra just boxed in my projection of "When do we get frontier models at home?" Why? Because they're copying the DGX Spark model: Dare you to have just one. 512GB M5 Ultra is $17.7k in Oct. It will take 4x to run Kimi K3. Apple is supporting this arrangement. This will be the most economical way to run Kimi K3 "at home" ... $71K. That's not really an "at home" price for most of us, but before that the most economical option was looking like it would be 8x B300 in a DGX B300 for around $550k. That's a rack-mount beast needing power and cooling consideration, not a cool and quiet desktop box that can plug into any average circuit. The costs and practicalities made it a real consideration only for SMBs with serious on-prem requirements. A 4x M5 Ultra cluster can sit anywhere and give practically fast frontier level model performance, before the end of this year!
더 보기