Niels Rogge
@NielsRogge
ML Engineer @huggingface. Building @KU_Leuven grad. General interest in machine & deep learning. Making AI more accessible for everyone!
가입 April 2010
745 팔로잉 중 24.1K 팬
For anyone wanting to read the research behind this, the paper is available on Papers with Code :)
"LLM-as-a-Verifier: A General-Purpose Verification Framework"
Find it here:
더 보기
Scaling self-verification with DeepSeek V4 Flash beats Claude Fable 5 on Terminal-Bench 2.1, while being 11x cheaper 💰
As open-source models become more capable, they can now generate large numbers of high-quality candidate solutions and verify their own outputs at very low cost.
For example, we find that sampling just 5 solutions with DeepSeek V4 Flash and ranking them using the same model with LLM-as-a-Verifier can lead to a significant boost in accuracy (79% → 88%), outperforming closed frontier models on Terminal-Bench.
Try it out today:
More on verification scaling in my previous post.
더 보기
