TwiScan
Hot
Communities
Account collections
Login
Register
English
ๆฅๆฌ่ช
ํ๊ตญ์
็ฎไฝไธญๆ
็นไฝไธญๆ
Register and share your invite link to earn from video plays and referrals.
Register now
vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
37
Following
54.1K
Followers
vLLM
@vllm_project
2026.05.08 14:00
๐ vLLM-Omni v0.20.0 is out โ aligned with upstream vLLM v0.20.0 (CUDA 13.0 ยท PyTorch 2.11 ยท Transformers 5.x). โก Qwen3-Omni throughput +72% on H20, 32 conc (0.241 โ 0.414 req/s) via talker / code2wav multi-replica scaling ๐๏ธ TTS faster & leaner: VoxCPM2 RTF 0.946 โ 0.106 ยท Fish Speech Fast AR latency -53% ยท Qwen3-TTS / Voxtral-TTS Code2Wav saves ~3.2 GiB ๐จ Diffusion dynamic step-level batching: +7.8% throughput / -5.8% latency ๐ New / improved: HunyuanImage-3.0, ERNIE T2I, AudioX, Wan2.2-S2V, LTX-2.3, FastGen Wan 2.1 ๐ฑ Wan2.2 on NPU production-ready: MindIE-SD, fused ops, VAE BF16, HSDP/USP โ +50โ60% perf ๐งฎ Quant expanded: Qwen Omni W4A16, OmniGen2 FP8, Z-Image FP8, HunyuanImage3 NPU, GLM-Image ๐งฉ Multi-backend updates across CUDA / ROCm / MUSA / NPU / XPU Check it out โ
Show more
0
0
15
235
27
Forward to community
Most Popular Users
Tibo
@thsottiaux
998K Followers
FinancialJuice
@financialjuice
957.1K Followers
CNBC
@CNBC
6.3M Followers
Seeking Alpha
@SeekingAlpha
346.7K Followers
TheStreet
@TheStreet
1.2M Followers
First Squawk
@FirstSquawk
578K Followers
The Wall Street Journal
@WSJ
22.3M Followers
Serenity
@aleabitoreddit
1.1M Followers
LiveSquawk
@LiveSquawk
504.5K Followers
Binance Wallet
@BinanceWallet
2.8M Followers
amit
@amitisinvesting
672.9K Followers
The Kobeissi Letter
@KobeissiLetter
2.7M Followers
Elon Musk
@elonmusk
241.4M Followers
zerohedge
@zerohedge
3.4M Followers
OpenAI
@OpenAI
5.5M Followers