PyTorch(@PyTorch):Get more out of your AI infrastructure. Carlos Costa, Distinguished Engineer at @IBMResearch and co-founder of the @_llm_d_ project will share some exciting news about llm-d: how the project changed the way the open source AI community scales inference at PyTorch Conference North America. A little over a year after the project was founded, llm-d is reaching a new level of maturity, delivering state-of-the-art performance for generative serving, while also enabling the capabilities needed for day two operations, including multi-tenant quality of service, zero downtime operations, and all of that without sacrificing performance in production. Join us in San Jose, October 20-21:

2026.10.12 20:08

Get more out of your AI infrastructure. Carlos Costa, Distinguished Engineer at @IBMResearch and co-founder of the @_llm_d_ project will share some exciting news about llm-d: how the project changed the way the open source AI community scales inference at PyTorch Conference North America. A little over a year after the project was founded, llm-d is reaching a new level of maturity, delivering state-of-the-art performance for generative serving, while also enabling the capabilities needed for day two operations, including multi-tenant quality of service, zero downtime operations, and all of that without sacrificing performance in production. Join us in San Jose, October 20-21: