AI capability vs. reliability is an extremely important issue. @sayashk makes a critical point by measuring reliability with different benchmarks (ex. agent accuracy rates) and finds reliability improvement greatly lags capabilities. AI labs should focus more on reliability now.
显示更多
