Register and share your invite link to earn from video plays and referrals.

Yuchen Jin
@Yuchenj_UW
Cooking fun AI systems & products @databricks. Prev: co-founder & CTO @ Hyperbolic, OctoAI (acquired by @nvidia) Apache TVM, PhD @ University of Washington.
Joined November 2016
893 Following    308.8K Followers
“A single cluster currently serves 155 trillion tokens/day, generating $38 in revenue per GPU-hour (at off-peak pricing).” Huge flex from DeepSeek. Not only did they open-source their inference engine, but they also open-sourced their revenue numbers. They didn't disclose which GPUs they're using here, but DeepInfer supports both NVIDIA Blackwell and Huawei Ascend. Even assuming they're renting B300s at $7 per GPU-hour, that's ~82% gross margin.
Show more
0
97
2.8K
181
Forward to community