Axiom Math's
@tobiges,
@nautsimon_ and
@a_ramabadran explain why AI can know the right move and still make the wrong one when driving a real car:
Tobi: "Even if you tell a car, 'You should turn left,' there's still a delay in what actually happens in the physical world, which you don't really have in coding or fully digital tasks. Even if models know in theory what they should be doing, it's still really hard to execute on these things properly."
Simon: "Hallucinations are still a problem in these models even at a massive scale. If there's even a 1% chance of it crashing, that's not something that we can necessarily trust."
Aditya: "I think it's called the knowing-doing gap. People have put them in ethical situations and been like, 'What would you do in this situation?' And then they actually put them in the situation and they do something different."
"Maybe they learn, 'This is what I should say,' but they don't internalize that this is actually how I change my behavior."
@axiommathai