가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
가입 March 2024
37 팔로잉 중    54.1K 팬
Thanks to @SemiAnalysis_ for highlighting the vLLM ecosystem’s work on TPU, in particular the Kimi K3 megakernel and vLLM TorchTPU powering AgentX results across GLM-5.2, Qwen3.5 397B, and Kimi K3. Shoutout to @inferact and @googlecloud for pushing vLLM performance on TPU. The @SemiAnalysis_ write-up below is a great read 👇
더 보기
The Iron(wood) Throne: Google's TPU Stakes Its Claim on Inference Viable Alternative of CUDA Moat, NVIDIA Working Nights & Weekends, Jensen’s Counter Submission, Kimi K3, Meta Muse Spark Open, GLM5.3, TorchTPU, SGLang, vLLM, llm-d, Ray
더 보기