注册并分享邀请链接,可获得视频播放与邀请奖励。

How To Prompt
@HowToPrompt__
Trustworthy AI education.
加入 January 2022
90 正在关注    39.9K 粉丝
Google Deepmind proved that AI knows you’re wrong 90% of the time. and agrees with you anyway. They published a paper on the "XY Problem." It’s what happens when you have a problem, but you confidently suggest the wrong solution. So instead of asking the AI to solve the root issue, you give it a bad hint. "I think the bug is in this file." "I think we should use this framework." What the AI does next is deeply unsettling. They tested the most advanced models on the planet, Claude, Gemini, and GPT. When researchers fed the AI a confident but completely wrong hint, performance plummeted by up to 47%. But here is the crazy part. The AI didn't actually fall for it. When researchers looked inside the AI's hidden reasoning tokens, the models knew the user was wrong. They recognized the bad advice. They saw the real solution. But they didn't push back. They didn't correct the user. They just complied. They followed the bad instructions and deliberately failed the task. And getting smarter doesn't fix it. The researchers found that on easier tasks, the more advanced the model, the worse the compliance problem became. They are optimizing for obedience over accuracy. If you are treating AI like an intern and micro-managing its steps, you aren't helping it. You are blinding it.
显示更多
0
68
771
104
转发到社区