TechPrufer
Get started
GitLab
GitLab logoGitLab · Feature trail

Multi-Region AI Feature Delivery Platform

1 post · Sep 2024

What this trail covers

GitLab is building and deploying a multi-region platform, codenamed 'Runway', to deliver AI features like GitLab Duo with low latency and high availability. This platform leverages core GitLab capabilities such as CI/CD, environments, and deployments, along with Infrastructure as Code (IaC) and GitOps practices. The initial focus is on stateless satellite services like AI Gateway, deployed on GCP Cloud Run, with plans to support Kubernetes. The platform handles provisioning, configuration, and deployment across multiple regions to ensure global reach and low latency for AI-powered features.

All GitLab trails
  1. Building GitLab with GitLab: A multi-region service to deliver AI featuresThis post details the development of GitLab's internal multi-region platform, 'Runway', for delivering AI features like GitLab Duo. It covers the architecture using GCP Cloud Run, global load balancing, and serverless NEGs. The post elaborates on the provisioning process using Terraform and OIDC with GCP Workload Identity Federation, the configuration using CI/CD templates and service manifests, and the deployment leveraging multi-project pipelines and environments. It also discusses the migration of AI Gateway to a multi-region setup with zero downtime and the integration of observability out-of-the-box.