Horace He(@cHHillee):It truly takes a village to release a model, perhaps especially an open weights model. Actually doing the entire process from scratch, from data to pretraining to posttraining to actual release, gives a lot of appreciation for anyone who does it! There's so many places to go wrong, and indeed so many things we would (and will!) do differently for a new model. But I'm happy with where we ended up :) Onto what's next!

Horace He

@cHHillee

@thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale

加入 February 2010

606 正在關注 52.6K 粉絲

Horace He@cHHillee

2026.07.15 18:18

It truly takes a village to release a model, perhaps especially an open weights model. Actually doing the entire process from scratch, from data to pretraining to posttraining to actual release, gives a lot of appreciation for anyone who does it! There's so many places to go wrong, and indeed so many things we would (and will!) do differently for a new model. But I'm happy with where we ended up :) Onto what's next!

1.3K

轉發到社區

熱門用戶