Niels Rogge
@NielsRogge
ML Engineer @huggingface. Building @KU_Leuven grad. General interest in machine & deep learning. Making AI more accessible for everyone!
Joined April 2010
745 Following 24.1K Followers
For anyone wanting to read the research behind this, the paper is available on Papers with Code :)
"LLM-as-a-Verifier: A General-Purpose Verification Framework"
Find it here:
Show more
Scaling self-verification with DeepSeek V4 Flash beats Claude Fable 5 on Terminal-Bench 2.1, while being 11x cheaper 💰
As open-source models become more capable, they can now generate large numbers of high-quality candidate solutions and verify their own outputs at very low cost.
For example, we find that sampling just 5 solutions with DeepSeek V4 Flash and ranking them using the same model with LLM-as-a-Verifier can lead to a significant boost in accuracy (79% → 88%), outperforming closed frontier models on Terminal-Bench.
Try it out today:
More on verification scaling in my previous post.
Show more
