Register and share your invite link to earn from video plays and referrals.

Matt Van Horn
@mvanhorn
Co-founded June (โ€œself-driving oven,โ€ acquired by @webergrills) & co that became @Lyft. Building again, more soon. OS: @slashlast30days 47kโ˜… @ppressdev 5.4kโ˜…
Joined May 2007
4.9K Following    37.6K Followers
TL;DR ELI5 of @satyanadella new post: the best AI product strategy is no longer renting the biggest model. It's training small in-house models inside the product until they match frontier quality on everyday tasks. ๐Ÿง  Frontier models are amazing but expensive. Most everyday tasks don't need them ๐Ÿ‹๏ธ Microsoft trained small MAI models inside the actual products (GitHub Copilot, Excel) using RL environments that reward completing real customer tasks, not benchmarks ๐Ÿ“Š The MAI model in Excel matches GPT-5.6 quality on the most common tasks at a fraction of the cost, and runs on older H100/A100 GPUs instead of the latest chips ๐Ÿ”€ They now route traffic to MAI wherever it matches frontier quality, and only call OpenAI/Anthropic models for true frontier needs ๐Ÿงฉ The trick is the system, not the model: harness, memory, context, tools, and evals all live outside the model, so any model can be swapped in or out and the product keeps improving ๐Ÿ“ˆ Code model became the Excel model: MAI-Code-1-Flash was the starting checkpoint for the Excel climb, going from ~72% to 86% on their evals ๐Ÿข Same playbook every enterprise can run with their own evals, RL environments, and workflows Small models trained in the product, frontier models on standby. That's the whole strategy.
Show more