Red Hat AI
@RedHat_AI
Accelerating AI innovation with open platforms and community.
The future of AI is open.
参加 May 2018
2.1K フォロー中 12.6K ファン
What does it take to serve a model that talks back, or one that generates video with audio?
Most text models advance one token at a time. These don't, and they need different scheduling to match.
New recap on how vLLM-Omni serves them:
もっと見る
