Matt Stockton
@mstockton
Mostly tweeting LLM stuff. Working w/ companies to help them do AI and ML @
Writing thoughts here:
2.6K Following 9.9K Followers
This is what I would type up if I were able to properly distill all the random thoughts in my brain and make them coherent for people to understand. Consider this tweet a very strong retweet, as I nod with a ‘yup, that’s it’
Show more
Folks - there’s not shortcuts here. You need to have data, you need to understand it, you need to clean it, you need to use it properly, you need to understand how it performs when flowing through your instructions
“the biggest alpha for most orgs trying to improve their agents will most def come from obsessively building good Eval + Data + Review hygiene”
Show more
Impressive stuff. Note the change over a 1-week timeframe.
This still takes a highly skilled and motivated engineering team to do something like this, but the tools are there.
I am guessing this category of work will continue to get more approachable to the 'median' engineering team over the next 12 months. I also expect the token cost-pressure for known use-cases 'at scale' will be a forcing function for more companies deciding to figure this stuff out.
Show more
This is a very good read. My favorite part, which I very much agree with:
“Encoding each firm’s nuances into agents will become the largest economic task of the decade ahead.”
