exo featured on Apple's new M5 Ultra Mac Studio and M6 / M5 Pro Mac Mini pages.
Over the past year, we have worked closely with Apple on low-latency RDMA networking over Thunderbolt 5, enabling clusters of Macs to run massive models like Kimi K3 and GLM-5.3 at API speeds.
With RDMA, aggregate memory bandwidth across Macs scales ~linearly.
A cluster of 4 x M5 Ultra Mac Studios scale to an aggregate memory bandwidth of ~4.8TB/s. Previously, these were speeds only achievable with data center GPUs.
Our vision is a data center on every desk. Apple Silicon's superior memory unit economics, power efficiency, and out of the box experience for Local AI make that possible.
Thank you to
@angeloskath,
@awnihannun,
@twid and countless others at Apple who tirelessly to bring this technology to the world.