VulcanBench
@VulcanBench
Benchmarking models across effort levels and harnesses on eval suites with real coding tasks. Because you don't need High or Max effort as much as you think.
Joined March 2020
73 Following 2.8K Followers
More interesting data from Artificial Analysis, really like what they're doing with PersonalityBench, definitely a tricky eval suite to build.
In AA-PersonalityBench, Gemini models are the most Confident and the least likely to Admit Uncertainty of all models measured
➤ Most Confident: Gemini 3.8 Flash (100), Gemini 4 Argon (97) and Gemini 3.1 Pro Preview (95)
➤ Least likely to Admit Uncertainty: Gemini 3.1 Pro Preview (1), Gemini 4 Argon (4) and Gemini 3.8 Flash (6)
Show more
