Red Hat AI(@RedHat_AI):You can now upgrade PyTorch without rebuilding vLLM. As of v0.33.0, vLLM ships LibTorch ABI Stable CUDA wheels, so you swap the torch wheel and import it, no vLLM rebuild to pick up a new PyTorch release. How @vllm_project, @RedHat, and @AIatMeta pulled it off:

Red Hat AI

@RedHat_AI

Accelerating AI innovation with open platforms and community. The future of AI is open.

Joined May 2018

2.1K Following 12.9K Followers

Red Hat AI@RedHat_AI

11hours ago

You can now upgrade PyTorch without rebuilding vLLM. As of v0.33.0, vLLM ships LibTorch ABI Stable CUDA wheels, so you swap the torch wheel and import it, no vLLM rebuild to pick up a new PyTorch release. How @vllm_project, @RedHat, and @AIatMeta pulled it off: