Rohan Pandey
@khoomeik
descending cross-entropy to ascend entropy @PeriodicLabs || prev research @OpenAI @CarnegieMellon '23
参加 February 2020
3K フォロー中 43.7K ファン
as of 5 minutes ago, our gpt-oss implementation is merged into torchtitan!
thanks to all the work by @jianiw_wang @__tianyu at @pytorch making it clean & scalable for the community ❤️
i hope y'all play around with training gpt-oss, it's great for its sparsity & reasoning
もっと見る
