@GavinSBaker Worth emphasizing that the OpenAI team has made an explicit bet that disagg is not the way to go. This was a very intentional decision on their part.
Time will tell who’s correct.
Jalepeno is the best example we have so far of extremely high roi token spend by a large enterprise to create an entirely new business line.
No surprise that it came first from OpenAI/Anthropic.