vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
37 正在關注 54.5K 粉絲
🎉 Congrats to @MistralAI on launching Voxtral 4B TTS — enterprise-grade TTS built for production voice agents. Day-0 support in vLLM Omni.
🌍 9 languages with natural prosody and emotional range
🎙️ 20 preset voices with easy adaptation to new ones
⚡ Ultra-low latency streaming, 24 kHz output in WAV/MP3/FLAC/AAC/Opus
Blog 🔗
Model 🔗
顯示更多
