Introducing LangSmith Engine v2: Detect and ship fixes to agents faster

We built LangSmith Engine as an in-platform agent that automates work at each step of the agent development lifecycle. Since launching in May, Engine has already helped engineers analyze more than 60M traces to diagnose tens of thousands of issues. Engine v2 introduces major advancements for issue detection, testing and validation. ✅ Proactively troubleshoot with Red Teaming: New Red Team capabilities help detect issues before they surface in production. Using production traces and repository context, Engine can generate hypotheses about issues that may not have appeared in production yet, test those hypotheses, and surface confirmed failures for review. ✅ Detect harder-to-spot issues: Engine now detects more issue types. In addition to errors and unmet user requests, it can identify performance trends across error rate, latency, and cost, as well as inefficient agent work such as repetitive tool calls or unnecessarily long trajectories. ✅ Automatically test proposed fixes: For agents running on LangSmith Deployment, Engine can now validate proposed fixes prior to human review and deployment. Engine v2 runs the offending inputs against your agent to confirm the issue. Then it tests candidate fixes against a broader eval set until it finds one that resolves the issue. Once Engine has a satisfactory fix, it’s presented to the end user, where they can open a PR with a click for quick deployment. Engine v2 is designed to make agent improvement more continuous and proactive. Learn more at https://www.langchain.com/blog/langsmith-engine-v2-redteam