Gemini 2.0: Level Up Your Apps with Real-Time Multimodal Interactions- Google Developers Blog
Dec 23, 2024Ivan Solovyev, Shrestha Basu Mallick

Summary
Introduced the Multimodal Live API for Gemini 2.0, enabling real-time, bidirectional streaming of text, audio, and video data via WebSockets. Key features include sub-second latency, natural voice conversations with interruption support, video understanding, tool integration within a single request, and steerable voices. This facilitates the development of interactive applications such as real-time virtual assistants and adaptive educational tools. Provided starter web application code and demo applications for exploration.
More from the Conversational Computing and Ubiquitous Interfaces trail
- Empowering Service Providers and Hardware Partners with Gemini for Home- Google Developers Blog
- Gemini for Home: Expanding the Platform for a New Era of Smart Home AI- Google Developers Blog
- Bringing Gemini intelligence to Google Home APIs- Google Developers Blog
- Achieve real-time interaction: Build with the Live API- Google Developers Blog
- The Gemini API and the Internet of Things- Google Developers Blog