don't be like me. I wasted about a month and many gpu hours at Figma trying to get opsd to work.
put the time and effort into constructing good rl envs and rewards instead.
opsd and its variants don’t work, no matter what they are biased and bias kills llms, please please please stop working on it, so many other great directions to explore that aren’t opsd
