GitLab Runner AWS Fargate Executor with CodeBuild Integration

1 post · Apr 2020 – Jul 2020

What this trail covers

GitLab Runner's AWS Fargate executor is enhanced to support container building by integrating with AWS CodeBuild. This addresses the limitation of Fargate not supporting privileged containers (required for Docker-in-Docker) by offloading the container build process to CodeBuild. The solution involves configuring GitLab Runner on Fargate to trigger CodeBuild jobs, which then build the container image using a provided buildspec.yml and Dockerfile. This enables building container images within CI/C

All GitLab trails

Jul 2020Building containers with GitLab Runner & AWS Fargate executorThis post details a workaround for building container images on AWS Fargate using GitLab Runner. It outlines the architecture where a Fargate-based CI job triggers AWS CodeBuild. The solution involves setting up an S3 bucket for build artifacts, creating a CodeBuild project configured to use S3 as a source and build containers, modifying the CI container image to include the AWS CLI and zip, creating a buildspec.yml for CodeBuild, a script to orchestrate CodeBuild jobs from GitLab CI, and configuring AWS credentials. The post provides step-by-step instructions for each component.
May 2020How autoscaling GitLab CI works on AWS FargateThis post announces the ability to auto-scale GitLab CI jobs on AWS Fargate managed containers, enabled by a new GitLab AWS Fargate driver for the Custom executor. The driver uses the AWS Fargate `run-task` action to schedule new tasks, where pipeline jobs execute on containers built from custom images. It details the driver's stages (Config, Prepare, Run, Cleanup) and the necessity of SSH connectivity between the driver and the build container. It also highlights the limitation of Fargate not supporting privileged mode (e.g., Docker-in-Docker) and promises future enhancements.
Apr 2020GitLab and Red Hat: Automation to enhance secure software developmentThis post announces the upcoming availability of the GitLab Runner Operator for OpenShift, indicating an engineering epic underway to develop first-class support for OpenShift. It highlights the collaboration with Red Hat to integrate GitLab's CI/CD and Auto DevOps workflows with Red Hat OpenShift, allowing application container images to be pushed to GitLab's registry and deployed into OpenShift. The overarching goal is to improve DevSecOps posture and reduce security/compliance risks.
Advertisement