alexa griffith
@alexa_griffith_
book enthusiast, senior principal engineer at Red Hat, Inference FDE, @alexasinput podcast host
加入 November 2019
521 正在关注 504 粉丝
How live requests, batch jobs, and background apps reach the same inference pool in llm-d.
Try it yourself:
