we’re in for another boom of cool interpretability research like The Lottery Ticket Hypothesis & Manifold Hypothesis with the rise of frontier open models
get to really dig into how frontier intelligence is able to model concepts across modalities (text, image, video, audio)
and how LLMs mechanistically execute search programs during rollouts to find the right trajectories across tasks