注册并分享邀请链接,可获得视频播放与邀请奖励。

Misha Goin
@mgoin_
maintainer @vllm_project, inference perf @RedHat_AI (acq @neuralmagic)
加入 April 2022
484 正在关注    2.8K 粉丝
130,093 tok/s *PER GPU* for DeepSeek V4 Pro on real agentic traces achieved by vLLM!! If you call @vllm_project slow just admit your skill issue lol