🦢 TL;DR: nails the timing of listening, speaking and interrupting, but task completion still lags. Tencent unveils an omni interaction model unifying speech, video and agentic execution. Title: Omni Interaction Agent Technical Report (Gander) URL: 📌 Highlights 🧠 Cerebellum-Brain design: real-time control layer + Claude/Codex-powered reasoning layer 🎙 Streams audio/video in 1-second chunks, no external VAD needed ✅ 100% turn-taking accuracy vs GPT-Realtime's 96% ⚠️ Task completion (Pass@1) only 0.400, below GPT-Realtime's 0.600 🔀 Feeding transcribed text straight to the Brain lifts Pass@1 to 0.520 🌐 Fusing audio+video boosts Daily-Omni by +19.13pt over single-modality 📦 Weights, training code and eval harness planned for release The honest takeaway: nailing conversational timing and nailing task accuracy are still two separate problems. #MultimodalAI# #VoiceAgents#

Voice agents are becoming a bigger part of customer and operational workflows globally, but getting them into production requires more than making the conversation sound natural. Join us for a practical session focused on a practical framework for evaluating production voice agents. We’ll cover how to assess tool use and task completion, connect conversations to real-world outcomes, and identify voice-specific issues like latency, interruptions, pacing, and conversational friction.

Voice Cloning is now live via the xAI API! Create a custom voice in less than 2 minutes or select from our library of 80+ voices across 28 languages to personalize your voice agents, audiobooks, video game characters, and more.

Grok Voice Think Fast 2.0 is STILL on top It ranks #1# on Artificial Analysis’ Speech Agent Arena with a 94.6% Task Success Rate Ahead of Gemini 3.8 Live, GPT-Realtime-2.1 High, GPT-Live-1 Astra and every other voice model tested And this benchmark measures real people talking to hidden voice agents across practical tasks... Then the benchmark checks whether the AI understood the request, used the right tools, and actually completed the job Not just sounding human but actually getting things done and Grok Voice is #1#

Conversational voice agents need to know when a different person is speaking, but not every background voice should count. We combined speaker embeddings with a post-trained audio-language model to determine when a speaker change matters.

Grok Voice Think Fast 2.0 is now #1# on the Artificial Analysis Speech-to-Speech Index. This index measures whether voice agents can reason over the speech it hears, resolve real customer issues, and correctly complete tasks using agent tools.

Grok Voice Agents can now run an entire customer support workflow from a single phone call It can now actually handle real support workflows while the call is happening: • Use the caller’s number to pull personalized account information • Securely access APIs through OAuth • Send SMS mid-call with confirmations, links, refunds and other details • Automatically email the team when the call ends with the conversation details Grok Voice Agents can now take the call → understand what you need → access your account → solve the problem → text the confirmation → notify the business Grok Voice is basically an autonomous customer support department for your business now

Grok Voice Agents can perform tasks and look up information on the fly. Developers can easily integrate their own custom tools or tap into xAI's real-time search capabilities across X and the web.

Grok Voice Agents are the fastest, most intelligent voice agents on the market. The Grok Voice Agent API ranks #1# on Big Bench Audio, the leading audio reasoning benchmark. Grok is nearly 5 times faster than the closest competitor. @ArtificialAnlys