Enabling more private generative AI- Google Developers Blog

Introduces GenC, an open-source project that simplifies the integration of Confidential Computing (specifically Confidential Space TEEs) with Gemma open-source models for private generative AI applications. Details a hybrid architecture using on-device Gemma 2B and cloud-hosted Gemma 7B within a TEE, connected via a model cascade. Explains the attestation process for verifying TEE integrity and the use of an Intermediate Representation (IR) for portable and language-independent deployment. Provides a Python code example demonstrating the setup.