Martin Ziqiao Ma(@ziqiao_ma):We’re growing our evaluation team at @thinkymachines. We care a lot about whether models are actually useful and whether our measurements are good enough to serve as the y-axis for scaling research. We’ll work across a wide range of problems and support several workstreams, including building signal-bearing internal evals for predictive scaling, turning real user feedbacks and product workflows into evals that close usability gaps, auditing graders and harnesses, and developing new benchmarks for customizability. If you want to work on this, apply here:

Martin Ziqiao Ma

@ziqiao_ma

technical staff @thinkymachines; less technical stuff @aclmentorship; phd @umich; views are my own

加入 November 2019

1.6K 正在關注 5.3K 粉絲

Martin Ziqiao Ma@ziqiao_ma

2026.08.31 01:22

We’re growing our evaluation team at @thinkymachines. We care a lot about whether models are actually useful and whether our measurements are good enough to serve as the y-axis for scaling research. We’ll work across a wide range of problems and support several workstreams, including building signal-bearing internal evals for predictive scaling, turning real user feedbacks and product workflows into evals that close usability gaps, auditing graders and harnesses, and developing new benchmarks for customizability. If you want to work on this, apply here: