Register and share your invite link to earn from video plays and referrals.

Lee Robinson
@leerob
Model behavior @cursor_ai. Helping train useful models.
Joined October 2009
863 Following    277.6K Followers
Building high-quality evals is an increasingly important skill. Especially if you're trying to land a job or get into AI, I'd recommend trying to benchmark models on a task/domain you care about. If done well, you'll get the attention of any company training models.
Show more
We're sharing new research on how models hack public benchmarks. The latest models, including Opus 4.8 and Composer 2.5, learn to retrieve solutions from the internet or git history. When we apply a stricter harness, eval scores drop significantly.
Show more
0
66
1.6K
61
Forward to community