Agam Bhatia
@chewing_a_gum
professional scriptrunner, CS + Math @Stanford
가입 October 2023
1.5K 팔로잉 중 558 팬
We often don't know how useful our interp tools are, or when they are lying to us. We stress-test this and more in WorkspaceBench!
Astra can do crazy things without chain-of-thought. This is scary, but interpretability can help!
We made WorkspaceBench, an eval that tells you how well your interp tool surfaces the contents of the global workspace, i.e. the important intermediate variables in a forward pass.
더 보기
