Tag: voice-agents
All the articles with the tag "voice-agents".
-
Evaluating voice agent quality at scale
Sourish BiswasWe improved how our voice agent identifies callers, but a pass/fail metric couldn't see the difference. Here is how we graded thousands of calls with a second model, and what we found when we checked the grader against human review.
-
Improving caller identification for voice AI agents
Sourish BiswasWhen callers aren't recognized by phone number, our voice agent looks them up by name and address. That lookup succeeded 5 times out of 70. Here is how we fixed it.
-
Improving tail latency in parallel LLM calls
Varun SrinivasanParallel LLM calls made our document search faster on average and much slower at the tail. One straggler set the latency for the entire phase.
-
A simple fix for LLM tail latency
Zhixuan LaiSend every request twice and take the faster response.