注册并分享邀请链接,可获得视频播放与邀请奖励。

Xinyu Yang
@Xinyu2ML
Building open frontier intelligence. Opinions are my own. They/Them
加入 December 2022
1.6K 正在关注    18.9K 粉丝
Nice work! While I'm not sure whether this design is practical enough on real hardware, the sparsity in both token and channel dimensions for attention is very elegant.