My favorite bits:
1. By *meta-optimizing* rubrics, we learn *features* that make expert-human writing superior & thus RL against those rubrics can produce *superhuman* text too.
2. In an online setting, this co-improves both rubrics+model, so extends beyond this specific task.
Show more
