AI capability vs. reliability is an extremely important issue.
@sayashk makes a critical point by measuring reliability with different benchmarks (ex. agent accuracy rates) and finds reliability improvement greatly lags capabilities. AI labs should focus more on reliability now.