This was sorely needed - we got many, many questions on "Why do Vals tbench numbers not match <lab>?"
In 90% of cases, the answer was, "We use the standard timeout limits; the lab used increased time limits".
顯示更多
All tasks in TB 4.0 are now set to a flat agent timeout of 8 hours. Frontier models never or rarely encounter timeouts now.