VulcanBench
@VulcanBench
Benchmarking models across effort levels and harnesses on eval suites with real coding tasks. Because you don't need High or Max effort as much as you think.
๊ฐ์
March 2020
71 ํ๋ก์ ์ค 2.7K ํฌ
Very cool ๐
Day 4 on the @droid Max plan ($200).
@FactoryAI sent a free voucher. I used Lauren Tan's (@poteto) pstack in Cursor for months, and I missed it when I moved to Droid. So I ported it.
The part I care about most is the model routing. Each role in pstack gets its own model, and I picked them from Morgan Linton's (@morganlinton) VulcanBench (@VulcanBench ) results instead of going on vibes.
Coding goes to GPT-6.1 Sol, which scored 97% of Opus 5.5's best for about a tenth of the cost. Opus handles the judgment calls, and the review panels mix models from three different labs.
There's also a budget mode that hands the grunt work to DeepSeek-V4.1-Flash
It checks Lauren's repo every week, so her updates keep coming.
๋ ๋ณด๊ธฐ
