Xinyu Yang
@Xinyu2ML
Building open frontier intelligence. Opinions are my own. They/Them
加入 December 2022
1.6K 正在關注 18.9K 粉絲
Nice work! While I'm not sure whether this design is practical enough on real hardware, the sparsity in both token and channel dimensions for attention is very elegant.
