Jen Zhu
@jenzhuscott
Cofounder/CEO, Power Dynamic | founder, Tech Fellowship @AspenInstitute | Research Fellow, Oxford University (Institute of Ethics)
Joined August 2011
1.5K Following 59.9K Followers
82% margin at rental GPU is insane for any lab - but DeepSeek will own most of the initial supply of Ascends.
Achieving this while being 20X cheaper than OAI & A is absolutely insane. And they OSS everything.
And OAI & A’s IPO - the public market will shred them in pieces.
Show more
“A single cluster currently serves 155 trillion tokens/day, generating $38 in revenue per GPU-hour (at off-peak pricing).”
Huge flex from DeepSeek. Not only did they open-source their inference engine, but they also open-sourced their revenue numbers.
They didn't disclose which GPUs they're using here, but DeepInfer supports both NVIDIA Blackwell and Huawei Ascend.
Even assuming they're renting B300s at $7 per GPU-hour, that's ~82% gross margin.
Show more
