Announcing GenAI Processors: Build powerful and flexible Gemini applications- Google Developers Blog

What this post added

Introduced GenAI Processors, an open-source Python library designed to structure and simplify the development of complex AI applications, especially those involving multimodal input and real-time responsiveness. GenAI Processors define a `Processor` interface for data handling, pre-processing, model calls, and output processing, treating all input and output as asynchronous streams of `ProcessorParts`. The library optimizes concurrent execution of processors to minimize Time To First Token (TTFT) and integrates with the Gemini API, offering `GenaiModel` and `LiveProcessor` for turn-based and real-time streaming interactions, respectively. Key design principles include modularity, asynchronous/concurrent operations via `asyncio`, extensibility, unified multimodal handling, and stream manipulation utilities.