alexa griffith
@alexa_griffith_
book enthusiast, senior principal engineer at Red Hat, Inference FDE, @alexasinput podcast host
加入 November 2019
521 正在關注 504 粉絲
llm-d flow control interactive learner, chapter 1: capacity utilization.
Here’s the same traffic in separate tenant-GPU reservations versus a shared pool. Sharing lets tenants use capacity that would otherwise sit idle.
顯示更多
