a coding agent delegating work and a consumer agent negotiating a refund are both “multiagent systems.” but only one lets you design both sides of the interaction.
wrote about what changes, from context and verification to incentives and training.
multimodal inference doesn't fit the mold of standard text autoregressive generation. text-to-speech models feature different architectures, different states, and different batch shapes. we rebuilt our tts serving around that and simultaneously reduced our time to first audio while improving throughput by several fold.