Register and share your invite link to earn from video plays and referrals.

Chris Painter
@ChrisPainterYup
President @METR_Evals
Joined November 2017
1.4K Following    13.9K Followers
Today we're sharing a method we've been using to measure AI agent capabilities: the "expenditure horizon". On an open-ended optimization problem, an AI agent given a small budget will often make more progress than a human given the same budget, because human time is expensive. The expenditure horizon is the budget at which the human catches up: the dollar value where a human's expected improvement, given the same budget, equals the agent's.
Show more