註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Misha Goin
@mgoin_
maintainer @vllm_project, inference perf @RedHat_AI (acq @neuralmagic)
加入 April 2022
487 正在關注    3.1K 粉絲
the strongest open model yet runs at 800+ tok/s/user on VR200 vLLM *on day 0* can’t wait to see how much faster we make it over the coming weeks 🔥