Joachim Schaeffer(@JSchaeff3r):Kimi K3.1 recalls instructions it was never given on Terminal Bench. They match the hidden tests. K3.1 while solving: "Instructions likely distilled pitfalls from previous agents." 🤯 When we edit a task to contradict them, K3.1 refuses the new instructions and fails. Other models follow the edit. Is it terminal(ly) benchmaxxed? 🧵

Joachim Schaeffer

@JSchaeff3r

AI Safety Researcher working on AI Control and Security

가입 November 2021

203 팔로잉 중 769 팬

Joachim Schaeffer@JSchaeff3r

2026.11.03 13:43

Kimi K3.1 recalls instructions it was never given on Terminal Bench. They match the hidden tests. K3.1 while solving: "Instructions likely distilled pitfalls from previous agents." 🤯 When we edit a task to contradict them, K3.1 refuses the new instructions and fails. Other models follow the edit. Is it terminal(ly) benchmaxxed? 🧵