注册并分享邀请链接,可获得视频播放与邀请奖励。

Misha Goin
@mgoin_
maintainer @vllm_project, inference perf @RedHat_AI (acq @neuralmagic)
加入 April 2022
487 正在关注    3.1K 粉丝
the strongest open model yet runs at 800+ tok/s/user on VR200 vLLM *on day 0* can’t wait to see how much faster we make it over the coming weeks 🔥