GitLab

Machine learning and DevSecOps: Inside the OctoML/GitLab integration

Feb 23, 2023Sameer Farooqui, OctoML
Machine learning and DevSecOps: Inside the OctoML/GitLab integration
SummaryAI, from the source post

This post details the integration of OctoML CLI with GitLab CI/CD pipelines to automate the optimization and deployment of machine learning models. It describes how new commits to inference code repositories can trigger OctoML CLI to optimize models for cost and latency, deploy them to a cloud registry, and then to managed Kubernetes services. The post outlines the four required stages for every pipeline (setup, package, deploy, test) and provides an example of the `octoml.yaml` configuration for model acceleration.

More from the AI-Assisted Features in DevSecOps trail