vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
37 Following 54.1K Followers
đ Congrats to @MistralAI on launching Voxtral 4B TTS â enterprise-grade TTS built for production voice agents. Day-0 support in vLLM Omni.
đ 9 languages with natural prosody and emotional range
đī¸ 20 preset voices with easy adaptation to new ones
⥠Ultra-low latency streaming, 24 kHz output in WAV/MP3/FLAC/AAC/Opus
Blog đ
Model đ
Show more
