가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

VulcanBench
@VulcanBench
Benchmarking models across effort levels and harnesses on eval suites with real coding tasks. Because you don't need High or Max effort as much as you think.
가입 March 2020
63 팔로잉 중    2.3K 팬
Announcing the next chapter.
I am excited to announce a new chapter for VulcanBench 🖖 🛡️ We are at a time in history where AI safety could possibly be most important way to make an impact in the world. As one human, I'm trying to increase the impact I can make. And I think there's an opportunity here, that I just can't stop thinking about. It's a different approach from what companies like METR are taking. And I'm not diminishing what they are doing in any way, but I am saying there is room for other approaches. I want to look at AI safety, as companies use AI today, in the actual harnesses they use, with the actual things, their teams are using AI for every single day. This is a big mission, and an important one, and in many ways, I am finding a bigger life purpose through it. More on VulcanBench Safety v1 here:
더 보기