Cooking fun AI systems & products @databricks. Prev: co-founder & CTO @ Hyperbolic, OctoAI (acquired by @nvidia) Apache TVM, PhD @ University of Washington.
Kimi K3 at 239 tokens/s!
Databricks is now #1# for Kimi K3 inference speed and latency on Artificial Analysis.
A huge 2.8T parameters model, it’s the largest oss model we’ve ever served. We make sure the GPUs go brrr at Databricks.