Opus 5.5 and Astra have me rethinking the baseline again. A few thoughts that I feel like went from an idea to concrete in my mind over the past few months:
1/ Delete tests - the models love to slop up tests and check that “abc” == “abc” all over the place. A lot of tests restate the code instead of test the code. This coupled with the fact that the models just write correct code these days has me feeling like unit tests are now just a waste of tokens.
2/ PRs and code review are a ceremony at this point - maybe on super critical pieces like payments, auth, etc. it’s still worth going line by line. Otherwise, have the model write the code, have the model test the code, have models review the code, and have the model drive computer use to prove that it works end to end. Stolen from
@thorstenball , “give me irrefutable proof this works end to end” often I ask for this in the form of a video and then I review demos and poke around myself.
3/ It’s orbing time - Of course everything is moving to cloud. I have discussed
@AmpCode a lot. You can see this pattern with Codex cloud from dev day. Moving your work to the cloud is a second unlock that is not about using the models well.
4/ The bar is higher - Motion design videos just got commoditized. You need to innovate where the models struggle (not much room anymore) or else you’re ngmi.
5/ Teammate, not tool - The models these days can triage and monitor. I don’t push releases without a thread that’s watching it, reading logs, and writing some doc. At worst case, I build up context about what actually happens in production. Best case, I get a hot fix automatically.
6/ Hillclimb - Overused word rn, but performance, optimization, and sweeping refactors are no longer scary. If you close the loop on task → validation and it can be proven on a computer, it’s solved.
I think some of us were early to jump to these conclusions with Sonnet 3.5, but they’re looking correct. At the same time, I have no idea where this goes from here.