Register and share your invite link to earn from video plays and referrals.

Jeff Ma
@18jeffreyma
CS PhD @Harvard + researcher @Meta Created
Joined June 2013
1K Following    1K Followers
super timely work, and a really great explanation for why models might feel "benchmaxxed"! SWE evals definitely feel extremely Markovian, which lends really well to compaction (since your codebase is essentially agent memory) real-world agent use is clearly multi-turn and partially-observable (uncovering requirements once you see your own spec assumptions challenged and overturned)
Show more