注册并分享邀请链接,可获得视频播放与邀请奖励。

Misha Goin
@mgoin_
maintainer @vllm_project, inference perf @RedHat_AI (acq @neuralmagic)
加入 April 2022
487 正在关注    3.1K 粉丝
@MainzOnX paged attention the idea is alive and well :) it's in literally every attention backend now! paged attention the circa 2023 .cu file has been unused for a while so we should stop building it