Catching agent bugs before deploy, not after they hit production. LangSmith just announced a new capability for exactly that. Title: LangSmith Engine v2: Red Teaming and Automated Testing URL: 📝 Overview LangSmith Engine automatically detects issues and generates fixes, and has analyzed over 70 million traces since its May launch. Version 2 adds two new capabilities: red teaming and automated fix validation. ❓ Problems Solved Developers used to face a tradeoff: ship an unverified fix or spend time on manual validation. Subtle degradations like rising latency or inefficient execution paths often slipped past human review entirely. 💡 Method & Approach Engine analyzes production traces and repositories to understand agent behavior, then systematically tests for weaknesses like hallucinations and prompt violations before they surface in production. It also reproduces failures in a sandbox, generates fixes, iteratively validates them against the original failing inputs, and surfaces only the validated solutions for human review. 📊 Results ・Issue detection improved more than 2x on IssueBench ・Generated fixes are 25% more effective per Terminal-Bench-style metrics 🌍 Use Cases Now available for LangSmith Plus and Enterprise SaaS users, with self-hosted support coming soon. Red teaming and automated testing are in private beta for Deployment users. #LangSmith# #AIAgents#