Own your AI: Self-Hosted GitLab Duo models with AWS Bedrock

What this post added

This post introduces the implementation of GitLab Duo Self-Hosted models, enabling organizations to deploy AI capabilities within their own infrastructure. It details the architecture involving a Self-Managed GitLab instance, an AI Gateway, and an LLM backend (specifically AWS Bedrock). The guide provides step-by-step instructions for installation, configuration of the AI Gateway and GitLab instance, model access and configuration within AWS Bedrock, and assignment of models to specific GitLab Duo features. It also covers verification steps through health checks, feature testing, and log review, and discusses model selection and alternative deployment options.