Tom Figliolia
@TomFigliolia
Joined July 2024
14 Following 43 Followers
We’ve found an empirical law governing plasticity loss in transformer models.
The surprising part: pretraining on uniform data distributions doesn’t seem to make models immune.
Most Popular Users
