Jack Morris
@jxmnop
research @engramlab // language models, information theory, science of AI
加入 October 2016
1.1K 正在關注 53.7K 粉絲
If you think about it, it's pretty embarrassing that frontier labs still pretrain models. Don't they know there's a theory for this? Given how big the model is, and how long you're going to train, you can predict the loss exactly. No need to actually train. They spend billions on this!
顯示更多
