Charles Foster
@CFGeek
On policy @METR_Evals 🧪 “excels at reasoning & tool use” 🪄 CoI disclosures on my Substack “About” page.
加入 June 2020
657 正在关注 4.2K 粉丝
It’s easy to mistake linear gains in ECI for linear gains in model performance. Each additional point actually *multiplies* a model’s odds of success on every benchmark. For example, historically each 5-point increase in ECI corresponded to roughly a doubling in time horizon.
显示更多
