Xidulu (at COLM / SF this week)
@xidulu
Xi Wang, Full-stack Bayesian, ECNU, UMass CICS, JHU CS, Fan of U-Shape.
Previously MSR Cambridge, Netflix Research, MSR NYC
952 Following 1.2K Followers
1/ A new revision of full-bandwidth transformer is on arXiv ( We included a few extra discussions on:
- How to debug training runs
- Post-training / KV cache replay
- Alternative fusion gate
Non-official code release at:
Show more
