MTS(@MTSlive):Discovered Materials' Akash Ramdas reveals a hilarious GPT 5.6 Terra hallucination: the model saw the materials science term "relaxation" and just gave up, writing about wanting to take some time off "I have a favorite example from a benchmark on this. We use terms like relaxation and screening. Screening's like to screen out properties. Relaxation is when you let the atoms go to their local favorite positions." "Our friend GPT 5.6 Terra read this and gave up with a blurb about how it wanted to relax and take some time off." "So yes, hallucination is an issue. But we're still excited by how you can build these frameworks around them to guide them to actually do good research."

2026.08.14 23:23

Discovered Materials' Akash Ramdas reveals a hilarious GPT 5.6 Terra hallucination: the model saw the materials science term "relaxation" and just gave up, writing about wanting to take some time off "I have a favorite example from a benchmark on this. We use terms like relaxation and screening. Screening's like to screen out properties. Relaxation is when you let the atoms go to their local favorite positions." "Our friend GPT 5.6 Terra read this and gave up with a blurb about how it wanted to relax and take some time off." "So yes, hallucination is an issue. But we're still excited by how you can build these frameworks around them to guide them to actually do good research."