Enabling more private generative AI- Google Developers Blog

What this post added

Introduces the GenC open-source project, which simplifies the integration of Confidential Computing, Gemma open-source models, and mobile platforms for building private generative AI applications. Details a hybrid architecture combining on-device and cloud-hosted LLMs within Trusted Execution Environments (TEEs) for enhanced privacy and security. Explains the use of attestation for verifying TEE integrity and the GenC framework's Intermediate Representation (IR) for cross-platform deployment.