Great article by @sonyatweetybird, esp on the importance of high-quality evals/benchmarks.
"Most evals start as a founder squinting at outputs and vibe-checking whether they feel right."
^we started here but have since invested an enormous amount of time, effort, and resources into building Legal Agent Bench and other internal eval sets to turn legal judgment into a hill-climable signal. It's created a powerful flywheel for us @harvey.
h/t @ItsJulioPereyra's team of legal researchers who bring their much needed domain expertise to the equation and at @BrendanFoody @mercor for helping us scale it up.
もっと見る
