VulcanBench(@VulcanBench):Over 142 continuous hours in building Wave 2 of my newest eval suite. A lot was done in this wave. For those just jumping in. I'm building the suite in parallel in Factory and Claude Code, comparing what each comes up with and using the best of both to finalize the full suite. This will be the first eval suite from VulcanBench all on the @harborframework, something I am very excited to be moving to. More to come 🖖

VulcanBench

@VulcanBench

Benchmarking models across effort levels and harnesses on eval suites with real coding tasks. Because you don't need High or Max effort as much as you think.

Joined March 2020

73 Following 2.8K Followers

VulcanBench@VulcanBench

2026.10.17 20:10

Over 142 continuous hours in building Wave 2 of my newest eval suite. A lot was done in this wave. For those just jumping in. I'm building the suite in parallel in Factory and Claude Code, comparing what each comes up with and using the best of both to finalize the full suite. This will be the first eval suite from VulcanBench all on the @harborframework, something I am very excited to be moving to. More to come 🖖