Incoming UC Berkeley prof. @sayashk says AI companies have spent billions on alignment while investing orders of magnitude less in agent control: "If you think about interventions on control, I would argue there have been orders of magnitude less investments." "Companies have spent billions of dollars on collecting training data for their alignment efforts and aligning the models themselves." "But on things like ensuring the security of their sandboxes or making sure that their transcript analysis is done correctly or making sure that agents don't go unmonitored and take actions in the real world, I think that has been far less of a priority. At least before this incident, the industry's main point of intervention was focused on alignment." @UCBerkeley