GitLab enhances its DevSecOps platform with AI/ML capabilities, including the introduction of GPU-enabled runners on GitLab.com. These runners accelerate ModelOps and HPC workloads, such as training and deploying large language models (LLMs). The post details how to use these runners, including selecting appropriate Docker images with NVIDIA CUDA drivers and verifying GPU functionality. It provides examples for Python model training and scientific simulations, and a more advanced example of AI-assisted development. Additionally, FIPS packages are evolving to use distribution-provided curl and OpenSSL for improved security and maintainability, shifting responsibility for curl security updates to the customer.
All GitLab trails