Morgan(@morganlinton):Okay, I'm off to sleep, the cybersecurity eval suite build will continue, possibly all night. Crossed 440,000 loc so decided it was probably time to push something. Looking forward to waking up and possibly having the first 16 tasks fully completed so I can start testing, poking holes in them, and improving. And a bunch of ppl asked me about Fable. Yeah, probably won't benchmark Fable on this as it will hit way too many guardrails, but will test Opus 5, and of course every other model that should be decent at cybersecurity.

2026.08.16 03:16

Okay, I'm off to sleep, the cybersecurity eval suite build will continue, possibly all night. Crossed 440,000 loc so decided it was probably time to push something. Looking forward to waking up and possibly having the first 16 tasks fully completed so I can start testing, poking holes in them, and improving. And a bunch of ppl asked me about Fable. Yeah, probably won't benchmark Fable on this as it will hit way too many guardrails, but will test Opus 5, and of course every other model that should be decent at cybersecurity.

显示更多