New blog post: “It’s Hard to Eval” Is a Product Smell If you find it hard to verify AI output, chances are that your users will too! In other words, I often find that product design is the bottleneck In the post I embed three **interactive before/after examples** based on products I've helped with: 1. an AI data agent that answers business questions 2. a PE lesson‑plan generator for K‑12 teachers 3. a workers’ comp tool that drafts 50‑page medical reports I believe this is a significant issue in AI Engineering and upstream of evals! Link to post: Note: I'm not a designer so the design sketches are far from perfect, but I felt it was important enough to spend a significant amount of time on this. Thanks to @sh_reya and @isaac_flath for feedback.

Codex desktop is miles ahead of Claude for remote access via mobile or another computer. Codex allows you to see **all** running sessions on **all** devices from any other device, including mobile You can truly go touch grass with Codex. Brings me joy every day

This post is completely outdated FWIW. Devin is really good now. One of my favorite tools. What's good about it: 1. UX is really great and super polished 2. Love how it gives me a video and visual proof of work 3. It actually works now Some of it is models are better but the UX/harness is also better. I suspect this blog post would not be written today.