when we host a model on workers ai, we have to consider if we're going to be able to serve a model economically + what demand looks like + what capacity we have.
testing models on @OpenRouter allows us to launch these things in market and gather data. if we have to tear a model down, your traffic gets routed to other providers. once we're confident in our deployment, then we bring it on platform for Workers AI users, where we commit to running the model for longer.
it's been a joy to work with openrouter team to enable us to experiment with models quickly 🧡
もっと見る
