Conversational Computing and Ubiquitous Interfaces

5/21/2026

Introduces Gemini for Home as a full-stack AI offering, combining Google Home APIs with Gemini features for service providers and hardware manufacturers. Details three core capabilities: camera intelligence, Ask Home, and Home Brief. Outlines new opportunities for service providers (Carriers, ISPs, security companies) to offer branded services like daily household awareness, advanced deterrence, and proactive protection by integrating Google Home Premium. Highlights AT&T's integration of Gemini features into their Connected Life app and security service. Expands the Google Home Gemini built in Program with validated reference designs for smart cameras and smart speakers to accelerate hardware development for partners.

10/1/2025

Introduces Gemini for Home, replacing Google Assistant on speakers and displays, enhancing cameras, and overhauling the Google Home app. It expands the platform for Google Home by enabling new Gemini-powered features for existing devices through the Works with Google Home program and launching a new program for AI cameras. This program includes a hardware reference design, a Google Home camera embedded SDK with on-device ML, and a split compute model for camera intelligence.

5/22/2025

This post announces the integration of Gemini intelligence into Google Home APIs, enabling developers to build more intuitive smart home experiences. Key contributions include: Gemini-powered camera features for developers (natural language querying, AI descriptions, history search), enhancements to the Automations API with suggested automations, conversational automation drafting, and new automation starters (date/weather-based). It also highlights Gemini's cross-surface integration for smart home control and the upcoming early access program for Gemini-powered Home APIs and developer challenges.

4/23/2025

Introduces the Gemini Live API, enabling real-time interaction with streaming audio, video, and text. Key new features include enhanced session management (longer sessions via context compression, session resumption, graceful disconnect notification), configurable turn control (voice activity detection, interruption handling), flexible session settings, expanded voice and language options for audio output, text streaming, and token usage reporting. Demonstrates real-world applications like Daily.co's Word Wrangler, LiveKit's AI copilot, and Bubba.ai's hands-free application for truck drivers.

12/23/2024

Introduced the Multimodal Live API for Gemini 2.0, enabling real-time, bidirectional streaming of text, audio, and video data via WebSockets. Key features include sub-second latency, natural voice conversations with interruption support, video understanding, tool integration within a single request, and steerable voices. This facilitates the development of interactive applications such as real-time virtual assistants and adaptive educational tools. Provided starter web application code and demo applications for exploration.

11/30/2021

This post introduces the ability to push dynamic shortcuts to Google Assistant, enabling personalized user journeys. It details how developers can leverage this capability to proactively offer relevant actions to users based on their context and predicted needs, thereby enhancing user engagement and streamlining interactions with Assistant-powered applications.

11/23/2021

This post introduces Interactive Canvas DevTools, a new set of debugging and testing tools for developers building conversational experiences with Google Assistant. These tools allow developers to inspect and debug their interactive canvas applications, including the ability to test voice interactions and view the state of the application in real-time. This enhances the developer workflow for creating rich, conversational interfaces.

12/20/2017

This post announces the expansion of the Google Assistant SDK to include new languages and API updates, specifically highlighting the introduction of Device Actions. Device Actions allow developers to integrate their products and services with the Google Assistant, enabling users to control devices and perform tasks using voice commands. This significantly broadens the scope of conversational computing by allowing for more direct interaction with physical devices and services through the Assistant.

4/27/2017

This post introduces the Google Assistant SDK, enabling developers to integrate Google Assistant's conversational capabilities into their own devices and products. It allows for programmatic control of Assistant features, including voice input, audio output, and device actions, facilitating the creation of custom voice-controlled experiences.

12/13/2016

This post announces updates to Google's Internet of Things (IoT) platform, specifically focusing on Android Things. It highlights the unification of Android Things with the Weave and Brillo platforms, creating a single, cohesive platform for IoT development. The update aims to simplify the development process for connected devices by providing a consistent environment across various hardware. It emphasizes the platform's ability to support a wide range of IoT devices and applications, from smart home devices to industrial IoT solutions. The post also touches upon the ongoing evolution of the platform to meet the growing demands of the IoT landscape.

9/19/2016

This post introduces the Actions on Google platform, a new developer platform that makes it easier to build conversational interfaces for Google Assistant. It provides tools and APIs for creating actions that can be invoked by voice, allowing developers to extend Google Assistant's capabilities with their own services and content. The platform aims to simplify the development of conversational experiences, enabling developers to build rich and interactive voice applications.

10/27/2015

Introduces Brillo, a new Android-based OS for IoT devices, and Weave, a communication platform for these devices, enabling them to interact with each other and with users through voice commands and other interfaces. This marks a significant step in realizing ubiquitous interfaces and conversational computing for the Internet of Things.

7/14/2015

Introduces the Nearby API, a new developer API that enables device-to-device communication and interaction, allowing apps to discover and connect with other nearby devices. This facilitates real-time, local interactions for a variety of use cases, including multiplayer gaming, file sharing, and collaborative experiences, without relying on an internet connection.

8/20/2009

This post introduces the concept of 'Conversational Computing' and discusses the potential of 'Ubiquity' and 'Jetpack' to enable these experiences. It highlights the vision of a future where computing is more integrated into daily life through natural language interaction, laying the groundwork for future developments in AI-driven interfaces and pervasive computing.