Jack Morris
@jxmnop
research @engramlab // language models, information theory, science of AI
参加 October 2016
1.1K フォロー中 53.7K ファン
If you think about it, it's pretty embarrassing that frontier labs still pretrain models. Don't they know there's a theory for this? Given how big the model is, and how long you're going to train, you can predict the loss exactly. No need to actually train. They spend billions on this!
もっと見る
