註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

EXO Labs
@exolabs
Frontier AI on local hardware. EXO 1.0 is now open-source (Apache 2.0):
加入 March 2024
3 正在關注    54.3K 粉絲
exo featured on Apple's new M5 Ultra Mac Studio and M6 / M5 Pro Mac Mini pages. Over the past year, we have worked closely with Apple on low-latency RDMA networking over Thunderbolt 5, enabling clusters of Macs to run massive models like Kimi K3 and GLM-5.3 at API speeds. With RDMA, aggregate memory bandwidth across Macs scales ~linearly. A cluster of 4 x M5 Ultra Mac Studios scale to an aggregate memory bandwidth of ~4.8TB/s. Previously, these were speeds only achievable with data center GPUs. Our vision is a data center on every desk. Apple Silicon's superior memory unit economics, power efficiency, and out of the box experience for Local AI make that possible. Thank you to @angeloskath, @awnihannun, @twid and countless others at Apple who tirelessly to bring this technology to the world.
顯示更多
0
63
1.4K
117
轉發到社區