Romain Lapeyre(@Romain_Lapeyre):Are you buying an AI agent product? Is your company building one? If so, how do you answer the following question: > Who has the best AI agent product in the market? < We worked on that question internally. At first, to benchmark ourselves against competition. Then to understand where are the gaps and what works well. It took a lot to build: - Run thousands of conversations - Building judges that can evaluate a dozen vendor - Plotting the results and solving for all edge cases Tomorrow at 11a, we're releasing results and open sourcing our approach to it. Hope you'll find it helpful to assess agents. Excited to tell you more!

2026.09.14 19:25

Are you buying an AI agent product? Is your company building one? If so, how do you answer the following question: > Who has the best AI agent product in the market? < We worked on that question internally. At first, to benchmark ourselves against competition. Then to understand where are the gaps and what works well. It took a lot to build: - Run thousands of conversations - Building judges that can evaluate a dozen vendor - Plotting the results and solving for all edge cases Tomorrow at 11a, we're releasing results and open sourcing our approach to it. Hope you'll find it helpful to assess agents. Excited to tell you more!