vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
37 ํ๋ก์ ์ค 54.1K ํฌ
๐ Congrats to @MistralAI on launching Voxtral 4B TTS โ enterprise-grade TTS built for production voice agents. Day-0 support in vLLM Omni.
๐ 9 languages with natural prosody and emotional range
๐๏ธ 20 preset voices with easy adaptation to new ones
โก Ultra-low latency streaming, 24 kHz output in WAV/MP3/FLAC/AAC/Opus
Blog ๐
Model ๐
๋ ๋ณด๊ธฐ
