註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在關注    46.7K 粉絲
🎉 Congrats to @PrimeIntellect on Verifiers v1! Its training rollouts run on vLLM for exact token IDs and logprobs, no tokenization drift, keeping rollouts and training in sync. vLLM powers a growing set of open RL infra, prime-rl and others, and it's an area we're going deep on. 🚀
顯示更多
0
5
92
12
轉發到社區