Xinyu Yang
@Xinyu2ML
Building open frontier intelligence. Opinions are my own. They/Them
Joined December 2022
1.6K Following 18.9K Followers
Nice work! While I'm not sure whether this design is practical enough on real hardware, the sparsity in both token and channel dimensions for attention is very elegant.
