This is a great thread from Jon. Jon and CRED were the first to not only test Snap but ship it to prod, and it took them only an HOUR! These results were exciting to us, because we’ve been doing a lot of work in the finance space with our LLM. Snap was equal to or better than Jev on six out of seven use cases while having better probability calibration (common feedback). The different was even bigger against the OpenAI Decisions API. More on this exploration together is coming soon!
The race to build the best AI decision-making model just got interesting!
We ran @subquadratic’s new model in production before launch, head-to-head against @typesafeai Jev, @OpenAI and Laya. The winner was the one that knew when it didn’t know. 🧵