Ryan Brooks
@rbro112
Staff Eng @sentry on AI/ML (all things evals)
Formerly employee 1 @emergetools (YC W21), mobile @airbnb
参加 June 2020
209 フォロー中 329 ファン
Working to get our agent tracing -> eval pipeline flowing.
It's manual right now, but using our own agent traces to build our eval dataset is the future.
Agree and we are doing this ourselves and helping our users do it too. An easy way to setup and use agent tracing data with your eval.
A little cookbook on this topic and there is a lot more to come around our own learnings and more cc @rbro112
もっと見る
