가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Wenhao Chai
@wenhaocha1
가입 January 2022
2.1K 팔로잉 중    7.1K 팬
we brought PPO back just for one reason: get way more out of each rollout GRPO is hard to scale, you can't just pay for as many rollouts as you want on every task. for math/coding an extra rollout is a couple more compiles and checks, whatever. for RSI it's a training run that costs thousands of dollars. and in bio we literally don't have multiple identical embryos to run in parallel we did some early stuff on keeping PPO training stable, hopefully some of it's useful to people
더 보기