Introducing Spork, an efficient post-training recipe which increases our solve-rate on chess puzzles by 100% when compared to our best GRPO setup.
It uses a GRPO warmup, splits task-specific datasets further into partitions, trains specialists, and then uses multi-teacher on-policy distillation. Like a Spork, it leverages gains by simply consolidating specialists.