Register and share your invite link to earn from video plays and referrals.

Romain Lapeyre
@Romain_Lapeyre
Co-founder & CEO @gorgiasio. Building Conversational Commerce, starting with Support and Shopping Assistant.
Joined March 2010
735 Following    1.6K Followers
I worked on 5 implementations last week and got some fresh learnings that might be helpful to you. The main blocker is building trust. Will the agent reship the right items? Will someone find a way to hack it and get refunds? We run lots of evals on AI agent, but until now we've been missing merchant level evals. You can manually test things in the playground, but it's been too much work to run. So we've added the ability for the MCP (and soon Gaia) to run these tests in batch and produce results on ˜100 tickets. This way, each time you make a change, you can run these evals, and get a sense for progress you're making. Then the magic is that you can iterate on this as a loop, and improve your skills running several loops. Try it now on the MCP, if you're open to sharing results, I'm keep to learn too!
Show more