Register and share your invite link to earn from video plays and referrals.

alexa griffith
@alexa_griffith_
book enthusiast, senior principal engineer at Red Hat, Inference FDE, @alexasinput podcast host
Joined November 2019
537 Following    540 Followers
llm-d flow control, chapter 8: same tenant, different priority. Tenant A at priority 100 and Tenant A at priority 0 have separate queues. Requests with the same fairness ID AND priority share a queue. That pair is called the FlowKey. Try it yourself:
Show more