When I read that an internal OpenAI model solved the Navier-Stokes problem, I realized it would be very hard for us to know if that model possesses similar "millennium intelligence" in biology (even if it does!). "Curing disease" is a noble goal, but we cannot validate proposed treatments rapidly enough to use it as a frontline eval for new models.
Here,
@SGRodriques and I propose Millennium Problems for Biology - meaningful, difficult challenges in biology whose solutions should be straightforward and quick to validate in a wetlab. If a model were to solve any of these, I would know that machine intelligence was capable of fundamentally reshaping humanity's ability to make, measure, and model biology.
Please see details of the problems in the thread below, and see our website for the permanent home of the list. I encourage the community to red-team these challenges to make sure they are adequately specified and difficult to cheat, and propose additional challenges to add. We will subsequently update the list in response to feedback.