Yu Zhang ๐๐
@yzhang_cs
@Kimi_Moonshot; working on efficient methods for LLMs; disciple of parallel programming; INTP; ๐
๊ฐ์
February 2023
925 ํ๋ก์ ์ค 6.8K ํฌ
Quick sync alongside the K3 report: FLA v0.5.2 is out ๐ข
- KDA fused kernels w/ FlashKDA backend
- KDA CP support
- Fused attnres
Enjoy it! cc @SonglinYang4 @uniartisan
