Patrick C Toulme
@PatrickToulme
gemini & TPUs @google. Formerly worked on Meta MTIA and AWS Trainium. Opinions are my own. All blogs shared are personal work.
가입 December 2025
411 팔로잉 중 15.5K 팬
TPUs are the best hardware and have the world’s best ML compiler XLA
@googlecloud and Inferact are announcing today a partnership to make TPU a first-class citizen in @vllm_project.
This partnership puts both teams on one engineering roadmap to bring TPU to the broader open model ecosystem, optimizing vLLM as the agentic production serving engine for TPU:
• Production serving features and optimized kernels
• A native PyTorch path via TorchTPU
• Moving towards day-0 support for frontier model releases
We're also launching a community program: shared TPU capacity for open-source contributors, plus dedicated review and design help from the core vLLM maintainers at Inferact.
Everything this collaboration produces is open source. Read the full announcement:
더 보기
