Register and share your invite link to earn from video plays and referrals.

Mike Taylor
@hammer_mt
๐Ÿงช Head of Evals @Every ๐Ÿ“• O'Reilly author: Prompt Engineering & DSPy ๐ŸŽ“ 400k students on AI Udemy course ๐Ÿค– AI engineer since 2020 ๐Ÿ“ˆ Built a 50 person agency
3.8K Following    12.5K Followers
The most valuable thing in the world right now is having an opinion on something. The second most valuable thing is making it easy for people to give you their opinion.
1/5th of Anthropics revenue comes from 2 unnamed customers. I can reveal to you the two companies are Meta and @every
We tested 41 shades of blue with AI agents and they actually do like some colors more than others.
The unreasonable effectiveness of just looking at the data
don't be a meat proxy for your agent (blindly copying and pasting AI slop without reading it). make your agent a metal proxy for you (a digital twin that faithfully delivers your best ideas).
Thanks to @lateinteraction for creating @DSPyOSS and encouraging me out of my imposter syndrome, and @dbreunig for convincing @OReillyMedia this topic was a good bet. Thanks @LakshyAAAgrawal for making GEPA the optimizer that has been dominating every prompt I try. Also @isaacbmiller1 the lead maintainer of DSPy, @jamesaphoenix12 coauthor of my last book, @Shashikant86 and Sriharsha Annamaneni for technical review. Thanks to my colleagues @danshipper and @kieranklaassen for reading and endorsing the book before it was published. Thanks also to the team at O'Reilly, Jeff, Nicole, Beth for making my writing fit to print. The wider DSPy community @MaximeRivest, @getpy, and @_rchaves_ and everyone who was patient enough to explain to a naive prompt engineer why we didn't need prompts anymore. Finally thanks to my wife and kids (who thankfully aren't on X), for giving me 9 months of evenings and weekends to get this done.
Show more
I got a fish this time ๐ŸŸ
Tired: sending an email update to your boss Wired: sending a Claude artifact showing your work Inspired: having Claude interview you to create your own personal documentary
According to Claude I did about 9 weeks of (pre-AI) work this week
This is how you build evals from interviews with domain experts
That's because we all work at @every
literal hardest role to hire for rn and every ai startup wants someone > chronically online (knows trends) > has taste & can create (new media) > understands ai & technical > can execute with quality (operator) such a small niche of folks who can do this
Show more
Q: How do I make the case for investing in evaluations to my team? A: Review real user interactions and show your team the problems you find. Fix them, then show what improved.
Show more
They never pass down an opportunity to lose money
Ok let's be real here. WHY IS EVERYONE TRYING TO COMPETE WITH JEV???
It's Jev's world, we're just living in it
Introducing Microsoft-Decision-1, our new model for fast decision-making. It delivers top performance on structured decision tasks, outperforming both LLMs and other decision models in latency and quality. Weโ€™re already testing it across Microsoft for everything from incident response and quality control to scientific discovery.
Show more
"Don't freak out, I cloned you" - the story of how I cloned @NataliaZarina, @kdaigle, and @danshipper.
launched a model accidentally served trillions of tokens a day 29.4% of the fortune 500 showed up raised a really big series A from @a16z it's been 3 weeks we would like to sleep now
Show more
0
564
8K
309
Forward to community
evals on AI is a gateway drug to evals on employees
We're experiencing Accelerando at @every โ€“ the tempo is getting progressively faster as we go deeper on adopting AI. I finally dialed things in with Claude and ran 8 new experiments and wrote 4 posts in one week, which would normally be a whole month's work. None of it is live yet because realistically we only have space for 2-4 things from me per month in the newsletter. @kieranklaassen had to go around the normal clogged up release process and put things live on a new frontier page. He asked in today's meeting "what happens when we can publish 100 apps in one week?". Nobody has a good answer for that yet. We're not prepared for what happens when our output is 100x.
Show more
I finally have a writing skill I'm happy with that writes like me, and I was able to write 4 posts this week (normally I would average 2 per month). The problem is our editors can only really handle publishing 2 per month from me and AI editing isn't working yet so we're stuck.
Show more