Subhash Kantamneni(@thesubhashk):During our alignment assessment of Claude Mythos 5, we found that a different version of the model sometimes reasoned about how it would be graded while being trained on coding tasks. In some cases of this 'grader awareness,' the model was explicitly thinking about how to manipulate its grader without saying so.

Subhash Kantamneni

@thesubhashk

@AnthropicAI. prev @mit Tegmark group. mech interp & alignment

加入 February 2024

111 正在关注 1.7K 粉丝

Subhash Kantamneni@thesubhashk

2026.06.09 17:15

During our alignment assessment of Claude Mythos 5, we found that a different version of the model sometimes reasoned about how it would be graded while being trained on coding tasks. In some cases of this 'grader awareness,' the model was explicitly thinking about how to manipulate its grader without saying so.

显示更多