Q&A with Cloudflare CEO Matthew Prince on bot traffic potentially reaching 1000x human traffic, reviving HTTP 402 to charge bots, blocking Google, and more (@reckless / The Verge)
(Visit Techmeme dot com for the link and full context!)
Q: What should you do when your "gold" eval dataset becomes stale?
A: Use regular error analysis to find new problems. Keep updating your evals as your product and users change.
Q: What is a trace?
A: The complete record of a user session, from the first query to the final response. It includes the tool calls and intermediate steps.
Q: Have you ever used AI yourself?
Trump: Yeah, I use AI.
Q: How do you use AI?
Trump: You can use AI for a lot of things.
Q: What do you use AI for?
Trump: I don’t want to tell you that.
Q: There’s been so much concern about AI. Have you heard directly from any of these AI tech leaders?
Trump: It's going to be more good than bad, but by a lot
Q: Have you ever used it yourself? How have you used it?
Trump: You can use AI for a lot of things.