Yuchen Jin(@Yuchenj_UW):“A single cluster currently serves 155 trillion tokens/day, generating $38 in revenue per GPU-hour (at off-peak pricing).” Huge flex from DeepSeek. Not only did they open-source their inference engine, but they also open-sourced their revenue numbers. They didn't disclose which GPUs they're using here, but DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. Even assuming they're renting B300s at $7 per GPU-hour, that's ~82% gross margin.

Yuchen Jin

@Yuchenj_UW

Cooking fun AI systems & products @databricks. Prev: co-founder & CTO @ Hyperbolic, OctoAI (acquired by @nvidia) Apache TVM, PhD @ University of Washington.

가입 November 2016

894 팔로잉 중 308.8K 팬

Yuchen Jin@Yuchenj_UW

2026.10.20 17:05

“A single cluster currently serves 155 trillion tokens/day, generating $38 in revenue per GPU-hour (at off-peak pricing).” Huge flex from DeepSeek. Not only did they open-source their inference engine, but they also open-sourced their revenue numbers. They didn't disclose which GPUs they're using here, but DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. Even assuming they're renting B300s at $7 per GPU-hour, that's ~82% gross margin.