注册并分享邀请链接,可获得视频播放与邀请奖励。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在关注    46.7K 粉丝
🎉 Congrats to @PrimeIntellect on Verifiers v1! Its training rollouts run on vLLM for exact token IDs and logprobs, no tokenization drift, keeping rollouts and training in sync. vLLM powers a growing set of open RL infra, prime-rl and others, and it's an area we're going deep on. 🚀
显示更多
0
5
92
12
转发到社区