engineers at @elicitorg are now all using inspect from ramp and i am confused by how, in this day and age, a credit card company can have the best coding agent harness
i disagree. i think we're hitting diminishing returns on static benchmarks. we need more algorithmic approaches and guarantees of quality. it's getting impossible to evaluate the scale of work agents are capable of now.
in many cases, if you can create the benchmark you've solved the task.