TwiScan
Hot
Communities
Account collections
Login
Register
English
ๆฅๆฌ่ช
ํ๊ตญ์
็ฎไฝไธญๆ
็นไฝไธญๆ
Register and share your invite link to earn from video plays and referrals.
Register now
vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
36
Following
45.4K
Followers
vLLM
@vllm_project
2026.05.08 14:00
๐ vLLM-Omni v0.20.0 is out โ aligned with upstream vLLM v0.20.0 (CUDA 13.0 ยท PyTorch 2.11 ยท Transformers 5.x). โก Qwen3-Omni throughput +72% on H20, 32 conc (0.241 โ 0.414 req/s) via talker / code2wav multi-replica scaling ๐๏ธ TTS faster & leaner: VoxCPM2 RTF 0.946 โ 0.106 ยท Fish Speech Fast AR latency -53% ยท Qwen3-TTS / Voxtral-TTS Code2Wav saves ~3.2 GiB ๐จ Diffusion dynamic step-level batching: +7.8% throughput / -5.8% latency ๐ New / improved: HunyuanImage-3.0, ERNIE T2I, AudioX, Wan2.2-S2V, LTX-2.3, FastGen Wan 2.1 ๐ฑ Wan2.2 on NPU production-ready: MindIE-SD, fused ops, VAE BF16, HSDP/USP โ +50โ60% perf ๐งฎ Quant expanded: Qwen Omni W4A16, OmniGen2 FP8, Z-Image FP8, HunyuanImage3 NPU, GLM-Image ๐งฉ Multi-backend updates across CUDA / ROCm / MUSA / NPU / XPU Check it out โ
Show more
0
0
15
235
27
Forward to community
Most Popular Users
New York Post
@nypost
4.1M Followers
Serenity
@aleabitoreddit
1M Followers
Reuters
@Reuters
26.3M Followers
billboard
@billboard
16.5M Followers
ใชใชใณใณใใฅใผใน
@oricon
1.9M Followers
Hello! Project Link
@UpFrontLink
15.5K Followers
BLACKPINKOFFICIAL
@BLACKPINK
11.6M Followers
First Squawk
@FirstSquawk
556.2K Followers
ไธๅๆตฃๆฅ็ง
@chee828
230.5K Followers
Pop Base
@PopBase
6.4M Followers
Forbes
@Forbes
20.3M Followers
MLB
@MLB
13.6M Followers
็ฑ
@W11n11124
20.1K Followers
BABYMONSTER
@YGBABYMONSTER_
956K Followers
Grok
@grok
9M Followers