Yuchen Jin(@Yuchenj_UW):Kimi K3 at 239 tokens/s! Databricks is now #1 for Kimi K3 inference speed and latency on Artificial Analysis. A huge 2.8T parameters model, it’s the largest oss model we’ve ever served. We make sure the GPUs go brrr at Databricks.

Yuchen Jin

@Yuchenj_UW

Cooking fun AI systems & products @databricks. Prev: co-founder & CTO @ Hyperbolic, OctoAI (acquired by @nvidia) Apache TVM, PhD @ University of Washington.

Joined November 2016

864 Following 301.5K Followers

Yuchen Jin@Yuchenj_UW

2026.08.03 17:04

Kimi K3 at 239 tokens/s! Databricks is now #1# for Kimi K3 inference speed and latency on Artificial Analysis. A huge 2.8T parameters model, it’s the largest oss model we’ve ever served. We make sure the GPUs go brrr at Databricks.