I've written a lot about how low latency is critical in voice agents, and it's quite a hard problem when you also need to keep accuracy super high.
Here's some insight into how our team approaches a portion of this!
Show more
Fast text serving ≠ fast speech.
Here's how we got our time to first audio under 30ms with nearly 10x more audio throughput.
