Thread AI CEO
@ae_mcneal explains why business logic is the real bottleneck in AI model routing:
"The technology behind a router I don’t think is as interesting as the application around it."
"How the business person or the engineering teams decide what models we pick, what are the things we’re trying to optimize."
"You have to predefine all of the decisions up front. We’ve decided what is expensive. How do you define expensive? Is it expensive in time, in people’s time, in money?"
"We spent a lot of time on those decision gates, because in the real world, those were the actual barriers to putting something in production."
@threadai_inc