Voice Authentication System

1 post · Dec 2025 – Sep 2026

What this trail covers

Decagon is developing a robust voice authentication system that addresses the unique challenges of identifying callers in voice AI interactions. This system balances security with user experience by offering flexible authentication models, including pre-authenticated and mid-conversation approaches. It focuses on selecting reliable voice identifiers, optimizing information collection methods (SMS, DTMF, voice transcription), and implementing incremental agent authentication to adhere to least privilege principles. The system is being enhanced with fine-tuned STT models for improved accuracy in authentication-centric utterances.

All Decagon trails

Sep 2026Audio-native semantic speaker-change detection | DecagonThis post introduces audio-native semantic speaker-change detection as a new capability within the voice authentication system. It details the problem of identifying relevant speaker changes in audio streams, contrasting it with standard ASR-to-LLM pipelines and diarization. The post outlines benchmark construction focusing on conversation-level false-positive rate (cFPR) and recall. It explores solutions using speaker embeddings (TitaNet) with methodologies like mean dissimilarity and maxsplit, and discusses multimodal post-training using synthetic datasets and supervised fine-tuning from first principles. The contribution enhances the system's ability to detect critical speaker transitions, thereby improving security and user experience by enabling timely interventions like re-authentication or action restriction.
Feb 2026Understanding enterprise AI answering services | DecagonThis post details the technical and compliance considerations for enterprise AI answering services, focusing on voice quality, agent autonomy, and action-taking capabilities. It outlines key functions like 24/7 availability, intelligent call handling, appointment scheduling, lead qualification, call routing, and CRM integration. The post also discusses benefits such as reduced missed opportunities, lower costs, enhanced customer experience, and improved efficiency. It highlights challenges like conversational complexity, action-taking capability, integration depth, and voice quality/latency. Legal aspects, including inbound vs. outbound call regulations (TCPA, HIPAA, GDPR), are covered. Decagon Voice is presented as a solution with real-time responsiveness, customizable voice profiles, cross-channel memory, smooth human escalations, SMS integration, and robust authentication methods.
Dec 2025May I ask who’s calling? How Decagon handles the challenge of voice authentication | DecagonThis post details Decagon's approach to voice authentication, highlighting the inherent difficulties of transcribing identifiers over voice, users multitasking, and the unreliability of phone numbers. It outlines two primary authentication models: pre-authenticated users (via web/app-gated calls, callbacks, or SIP/metadata transfer) and mid-conversation authentication. For mid-conversation, it compares various methods like mobile app notifications, multi-part identifiers, OTPs, and knowledge-based tests, emphasizing tradeoffs between security and user friction. The post also discusses the selection of appropriate identifiers based on ease of retrieval, security, and reliable voice capture, and details information collection methods such as SMS, DTMF, and voice transcription. A key contribution is the concept of 'incremental agent authentication,' where an agent's access strengthens over the call based on user verification, adhering to least privilege and Zero Trust principles. The post also mentions investment in fine-tuning STT models for authentication-specific utterances.
Advertisement