"How much do large language models memorize" by
@jxmnop et al. is a fantastic paper that received one of the best paper awards at ICML 2026
I took the central thesis of the paper and asked ML Intern to reproduce it. It's really cool to see it
- come up with a plan
- set a hard budget for gpu compute
- run experiments, track the right metrics
- reproduce the central claims (at a smaller scale) for <$8
Incredibly useful for reviewers or anyone building on top of the work!