alexa griffith
@alexa_griffith_
book enthusiast, senior principal engineer at Red Hat, Inference FDE, @alexasinput podcast host
Joined November 2019
521 Following 504 Followers
llm-d flow control interactive learner, chapter 1: capacity utilization.
Here’s the same traffic in separate tenant-GPU reservations versus a shared pool. Sharing lets tenants use capacity that would otherwise sit idle.
Show more
