Ben Davis(@davis7):I ran this thing through 10 tasks on DeepSWE (so there could be a ton of variance in it's real score, this is a subset), but uh... gpt-5.6-sol: 52% fable: 65% whatever the hell this is: 80% (was a near miss on the "x"s so actually over 80%) I am very confused

Ben Davis

@davis7

yells at @theo both on and off camera (co-host of the nerd snipe podcast)

Joined July 2022

532 Following 22.1K Followers

Ben Davis@davis7

2026.08.21 04:20

I ran this thing through 10 tasks on DeepSWE (so there could be a ton of variance in it's real score, this is a subset), but uh... gpt-5.6-sol: 52% fable: 65% whatever the hell this is: 80% (was a near miss on the "x"s so actually over 80%) I am very confused