Rohan Pandey
@khoomeik
descending cross-entropy to ascend entropy @PeriodicLabs || prev research @OpenAI @CarnegieMellon '23
가입 February 2020
3K 팔로잉 중 43.7K 팬
as of 5 minutes ago, our gpt-oss implementation is merged into torchtitan!
thanks to all the work by @jianiw_wang @__tianyu at @pytorch making it clean & scalable for the community ❤️
i hope y'all play around with training gpt-oss, it's great for its sparsity & reasoning
더 보기
