We recently introduced support in @togethercompute endpoints for seamless A/B experiments and rollouts. Our customers are using this to rollout new weights safely and rapidly for small to large deployments.
顯示更多
Shadow traffic proves a candidate is operationally sound. It can't tell you if users like it better.
A/B testing belongs at the endpoint, not in your app code. Same endpoint name, API, and keys for your clients. No feature flags, no hash-mod-100 in client code, no spreadsheet explaining what group A vs B means.
Split a live endpoint's traffic into one control and up to 20 variants, each with a fixed percentage. Ramp with a single call. Delete the experiment and 100% of traffic returns to the control, with nothing left to unwind.
Read the full walkthrough:
顯示更多
