everyone is asking us at @cxodev about calculating ROI on AI, here's what we're saying: 1. focus on engineering, it's 80%+ of your spend - if you're looking to improve cost efficiency its the big lever to move (so stop wasting time in other depts) 2 . model tests + evals are your friend. learn to run them for the most expensive parts of your business 3. spend time with your top spenders: they're either a) doing things your full team should do or b) an easy spot to save some $$$ 4. you're probably underspending relative to oppty all things considered 5. PR velocity is a good not great measure of eng ROI. you need to tie to actual product intiatives and use 6. if you're not sucking up session data + traces you can't really tell if your team is using AI on the right things 7. everyone is blowing through their 12 month budget in 4 months. you're not alone 8. aim for 2-10x improvements in ops efficiency. 30% is a rounding error. 9. time saved =/= ROI. what are you doing with that time? 10. you should be eliminating whole categories of human toil 11. nobody calculated the roi of email. some of this is simple work transformation 12. idk we still like tokenmaxxing 13. you will spike up and then it will be possible to pull down costs (but not output) - we see it all the time. intelligence is getting cheaper. 14. revenue per fully loaded employee is emerging as the north star guide. most leaders won't say that out loud to their teams. 15. spend capping your top users is dumb. they're the ones most likely to be highest impact if you really look. 16. sorry, but you just don't have that many fable-level problems. stop making it your defaut. what am i missing?