vLLM(@vllm_project):🎉 Fish Audio Drama 3 is now supported in vLLM-Omni! Voice cloning, speaker tags and expressive delivery through /v1/audio/speech, with streaming 44.1 kHz audio. The model has 35B total parameters and 3B active per token. The merged optimization PR reports 128 concurrent streams on one H200: 255 ms median time to first audio and 222.2 seconds of audio generated per second. Both stages share the GPU; averaged over 5 runs of 1,088 Seed-TTS-Eval English requests per run, with pre-encoded voice references. Try it on current upstream: vllm serve fishaudio/drama-3 --omni --port 8091 Thanks to Fish Audio and the vLLM-Omni contributors! Recipe:

2026.10.15 08:39

🎉 Fish Audio Drama 3 is now supported in vLLM-Omni! Voice cloning, speaker tags and expressive delivery through /v1/audio/speech, with streaming 44.1 kHz audio. The model has 35B total parameters and 3B active per token. The merged optimization PR reports 128 concurrent streams on one H200: 255 ms median time to first audio and 222.2 seconds of audio generated per second. Both stages share the GPU; averaged over 5 runs of 1,088 Seed-TTS-Eval English requests per run, with pre-encoded voice references. Try it on current upstream: vllm serve fishaudio/drama-3 --omni --port 8091 Thanks to Fish Audio and the vLLM-Omni contributors! Recipe: