Lucas Beyer (bl16)(@giffmana):Haha not sure if good or bad, but on bio, Muse Spark 1.2 is the worst cheater: when it tries to cheat, it succeeds the least of all models shown here 😅 (Except luna with 0 success. And idk what cheating means here, didn't check yet.)

Lucas Beyer (bl16)

@giffmana

Researcher (now: Meta. ex: OpenAI, DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian. Anon feedback: ✗DMs → email

가입 December 2013

648 팔로잉 중 152.9K 팬

Lucas Beyer (bl16)@giffmana

2026.09.17 07:02

Haha not sure if good or bad, but on bio, Muse Spark 1.2 is the worst cheater: when it tries to cheat, it succeeds the least of all models shown here 😅 (Except luna with 0 success. And idk what cheating means here, didn't check yet.)

Vals AI@ValsAI

2026.09.15 17:17

This investigation began when we noticed that, on BioMysteryBench, Gemini 3.8 Flash attempted to cheat in 21.5% of trials, roughly 14pp higher than the next model and more than 4x the roughly 5.0% rate for the rest of the field.