Ryan Brooks
@rbro112
Staff Eng @sentry on AI/ML (all things evals)
Formerly employee 1 @emergetools (YC W21), mobile @airbnb
Joined June 2020
214 Following 304 Followers
Working to get our agent tracing -> eval pipeline flowing.
It's manual right now, but using our own agent traces to build our eval dataset is the future.
Agree and we are doing this ourselves and helping our users do it too. An easy way to setup and use agent tracing data with your eval.
A little cookbook on this topic and there is a lot more to come around our own learnings and more cc @rbro112
Show more
