Cooking fun AI systems & products @databricks. Prev: co-founder & CTO @ Hyperbolic, OctoAI (acquired by @nvidia) Apache TVM, PhD @ University of Washington.
For the first time, an open-source AI lab has trained a nearly 3T-parameter frontier model.
Even more impressive, Kimi did it with fewer, and nerfed Nvidia GPUs.
Innovation loves constraints.