Bring your own model to GitLab Duo Self-Hosted with Microsoft Foundry

This post details the technical implementation of connecting GitLab Duo Self-Hosted to models hosted in Microsoft Foundry. It outlines the architecture involving a self-managed GitLab instance, an AI Gateway, and model endpoints deployed in Foundry. Key steps include deploying models in Foundry, recording endpoint URLs and API keys, and installing the AI Gateway. It emphasizes the importance of selecting models based on GitLab's supported-model matrix and Foundry's catalog, and provides guidance on naming conventions for deployments to facilitate upgrades. The post also clarifies data transmission policies, noting that inference data stays within the user's network for self-hosted configurations, while billing metadata is transmitted for online licenses.