Confidential AI for GitLab Self-Hosted

What this post added

This post introduces the integration of Privatemode AI with GitLab Duo Self-Hosted, enabling the use of confidential computing for AI coding agents. This allows organizations with strict data privacy and regulatory requirements to leverage AI features without sending source code or prompts outside of an encrypted boundary. The integration works by using a self-hosted AI Gateway that forwards requests to a Privatemode proxy, which then uses remote attestation to verify a hardware-based trusted execution environment (TEE) before establishing an encrypted channel for inference. This approach addresses the challenges of using AI in regulated industries by providing cryptographic guarantees that data remains encrypted during processing, even from the service operator or cloud provider.