Automate detection testing with GitLab CI/CD and Duo
Apr 30, 2026Evan Baltman

Summary
This post introduces the WATCH (Weekly Attack Testing for Continuous Health) framework, an automated system for testing security detections. WATCH simulates malicious behavior in GitLab's staging environment to validate that detections fire end-to-end through the SIEM and SOAR. It leverages GitLab CI/CD for scheduling, execution, and verification. The framework is designed for ease of use, allowing engineers to write new tests by subclassing `BaseSecurityTest` and focusing on setup, execution, and cleanup. GitLab Duo is highlighted as a tool to accelerate test creation by scaffolding WATCH tests based on prompts and Duo Agent Skills.
More from the Log Management and Observability trail
- Green DevOps: Why carbon measurement belongs in your CI/CD pipeline
- How to build CI/CD observability at scale
- Track vulnerability remediation with the updated GitLab Security Dashboard
- More granular product usage insights for GitLab Self-Managed and Dedicated
- Improve security auditing with GitLab Operational Container Scanning