Xinyu Yang
@Xinyu2ML
Building open frontier intelligence. Opinions are my own. They/Them
参加 December 2022
1.6K フォロー中 18.9K ファン
Nice work! While I'm not sure whether this design is practical enough on real hardware, the sparsity in both token and channel dimensions for attention is very elegant.
