Tom Figliolia
@TomFigliolia
加入 July 2024
14 正在关注 43 粉丝
We’ve found an empirical law governing plasticity loss in transformer models.
The surprising part: pretraining on uniform data distributions doesn’t seem to make models immune.
热门用户
