Langston Nashold
@langstonnashold
Cofounder of @ValsAI
Joined April 2024
251 Following 540 Followers
This was sorely needed - we got many, many questions on "Why do Vals tbench numbers not match <lab>?"
In 90% of cases, the answer was, "We use the standard timeout limits; the lab used increased time limits".
Show more
All tasks in TB 4.0 are now set to a flat agent timeout of 8 hours. Frontier models never or rarely encounter timeouts now.
