VulcanBench
@VulcanBench
Benchmarking models across effort levels and harnesses on eval suites with real coding tasks. Because you don't need High or Max effort as much as you think.
Joined March 2020
57 Following 2K Followers
It's official, Astra has saturated some of the most advanced benchmarks out there.
Excited to test it on our new eval suite once we have access.
Really hoping we can stump it, but also happy for the challenge of iterating and building new evals for the beast of a model Astra sounds like it is.
Live long and benchmark 🖖
Show more
