Spencer Poff(@spencerpoff):The bitter lesson only applies to methods, not to verifiers. Distilling ambiguity into quantified directional signal is the first step in solving real world problems with computation. In this talk at Weights Unknown, I describe the annoyingly simple eval framework we use at Harvey to build P-sets for legal expertise, and how we lean on the frontier ecosystem to find the methods that optimize against them. Credit for most of the work behind the talk goes to @nikogrupen, @ItsJulioPereyra, @gabepereyra, and frontier ecosystem partners @appliedcompute, @baseten, @EngramLab, @FireworksAI_HQ, @trajectorylabs (+ many more!) Thanks @AmplifyPartners for having me!

2026.08.28 21:06

The bitter lesson only applies to methods, not to verifiers. Distilling ambiguity into quantified directional signal is the first step in solving real world problems with computation. In this talk at Weights Unknown, I describe the annoyingly simple eval framework we use at Harvey to build P-sets for legal expertise, and how we lean on the frontier ecosystem to find the methods that optimize against them. Credit for most of the work behind the talk goes to @nikogrupen, @ItsJulioPereyra, @gabepereyra, and frontier ecosystem partners @appliedcompute, @baseten, @EngramLab, @FireworksAI_HQ, @trajectorylabs (+ many more!) Thanks @AmplifyPartners for having me!

轉發到社區