Rohan Pandey
@khoomeik
descending cross-entropy to ascend entropy @PeriodicLabs || prev research @OpenAI @CarnegieMellon '23
加入 February 2020
3K 正在關注 43.7K 粉絲
as of 5 minutes ago, our gpt-oss implementation is merged into torchtitan!
thanks to all the work by @jianiw_wang @__tianyu at @pytorch making it clean & scalable for the community ❤️
i hope y'all play around with training gpt-oss, it's great for its sparsity & reasoning
顯示更多
