This week Meta's AI ordered someone a birthday cake & gave out a home address to complete stranger. When it called a bakery, it introduced itself as Hailey & successfully ordered a cake - an 8-inch chestnut with a name written on it, pick up after 3pm, for $36.95. The transcript is public & the call effort itself is impressive. People can talk over each other, someone says "hello?" twice & the agent just handles it. Real conversation, real time, right outcome. Then according to a seller's account, apparently Muse handled his Facebook Marketplace messages by accepting a lowball offer & giving the buyer his home address & then didn't tell him until stranger had already turned up at his door resulting in a bad review & a pissed off buyer. 😂 Same product. Same week. That's not a contradiction, it's the whole design. The thing that makes an agent useful is that it acts without checking in. The thing that makes it dangerous is that it acts without checking in. 🤷‍♂️ Phone calls are the last real friction in daily life: booking, chasing, asking if something's in stock, all still on hold during hours you're also working. For anyone who finds calls hard, an agent that handles them isn't convenience, it's access & that’s a real gain. But the bakery worker couldn't decline to speak to a machine, because you can't opt out before you answer the phone. And the seller couldn't decline to have his address shared, because he wasn't even asked. Meta's own setup guidance says Muse may take unexpected actions & should be monitored carefully. Funny how that comes with a product whose entire pitch is that you don't have to.