Yun-Ta Tsai(@yunta_tsai):One common pitfall of ML engineering is over-relying on external benchmarks to judge how good a product is without understanding what makes a good product. A good eval should capture the actual product experience. If the engineer who trains the model cannot craft one, they do not understand or care about the problem deeply enough.

Yun-Ta Tsai

@yunta_tsai

Sr. Staff Engineer @Tesla_AI

Joined October 2022

225 Following 153.6K Followers

Yun-Ta Tsai@yunta_tsai

2026.09.17 14:49

One common pitfall of ML engineering is over-relying on external benchmarks to judge how good a product is without understanding what makes a good product. A good eval should capture the actual product experience. If the engineer who trains the model cannot craft one, they do not understand or care about the problem deeply enough.

108

Forward to community

Most Popular Users