VulcanBench
@VulcanBench
Benchmarking models across effort levels and harnesses on eval suites with real coding tasks. Because you don't need High or Max effort as much as you think.
๊ฐ์
March 2020
71 ํ๋ก์ ์ค 2.7K ํฌ
I believe in independent benchmarks, pass it on ๐
I believe in independent benchmarks.
Any model company that tells you not to trust benchmarks, is a company with something to hide imo.
Proud of all the support I have seen from just about every ai lab out there supporting me and VulcanBench ๐
The moment we stop trusting public benchmarks, or worse, insulting and attacking the researchers that run them, is the moment we lose our own independence.
Hereโs to the bright future of open source, free, independent benchmarks.
It is one of my greatest honors to benchmark the frontier, nothing more exciting, except maybe rocket launches ๐
๐
๋ ๋ณด๊ธฐ
