註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

elvis
@omarsar0
Building the frontier @dair_ai • Prev: Meta AI | Galactica LLM | Papers with Code | Elastic | PhD
加入 September 2015
1.4K 正在關注    327.1K 粉絲
Your agent traces are your best eval data. The most important failures only show up in production, and they rarely make it into your test set. DigitalOcean's Signals flags sessions where users got frustrated or tools failed and turns them into evals with one click. Simulations then replay them against your fix on your agent's real harness before it ships. If you're running agents in production, you need this loop.
顯示更多
Catch it at the first user, not the four-hundredth. A new user’s bank link fails, the agent says “try again later,” and nothing shows up in the logs. Watch a team find the bug and fix it before anyone else hits it, with Agent Learning Services and Agent Data Services, launching today.
顯示更多
0
17
27
1
轉發到社區