Base Labs(@baselabs):We also investigated different amounts of distillation and the rate of accuracy improvement that distillation confers, amongst other results. This is a first step toward understanding how different forms of distillation affect RL, and how to warm-start model training more effectively. Full work:

Base Labs

@baselabs

A research lab by @baseten working to advance and democratize open-source intelligence.

Joined July 2026

14 Following 2.6K Followers

Base Labs@baselabs

2026.09.23 21:52

We also investigated different amounts of distillation and the rate of accuracy improvement that distillation confers, amongst other results. This is a first step toward understanding how different forms of distillation affect RL, and how to warm-start model training more effectively. Full work: