Varoon Kodithala
@varoonkodithala
Joined August 2019
1.2K Following 1.3K Followers
the factory improves itself! more here soon...
We have a number of scorers running against our internal Warp factory, one of which grades the verbosity of agent conversations.
I made a change earlier to make it stricter because our agents are creating overly verbose PR descriptions. This caused the scorer pass rate to drop.
The scorer run details show how it detected one particularly bad PR description.
This is a simple example of how we can detect our code review skill needs tuning.
Show more
