Giles Thomas
@gpjt
Building LLMs, learning in public / Founded and led @PythonAnywhere / PSF Fellow
가입 June 2007
198 팔로잉 중 1.6K 팬
I'd trained some models on 40 tokens per parameter. The Chinchilla paper says that doing that is suboptimal. I wanted to see if that was correct for my training setup -- and it looks like it was :-)
더 보기
