Proud to collaborate with
@gimletlabs on their Inference Cloud.
Planned speeds of up to 3,000 tokens per second.
Gimlet's software breaks inference into phases and runs each phase on the silicon best suited to it.
@cerebras handles the work where speed matters, and GPUs handle the high-throughput work.
Users get faster AI and operators get better data center economics.
Our teams have been working with joint customers since last year, and the integrated system is already serving tokens in private deployments.
Gimlet is also a launch partner for CS-4. The first Cerebras-powered Gimlet Cloud data center is expected to come online later this year.
Thank you to
@zainasgar and the Gimlet team.