Orchestrating Chaos Using Grab's Experimentation Platform

This post details the implementation of chaos engineering at Grab by integrating it with the existing Experimentation Platform (ExP) and Grab-Kit. It introduces a Chaos SDK built on top of the ExP SDK, allowing for application-level chaos injection (errors, CPU load, memory leaks, latency, disk space, goroutine leaks, panics, throttling) directly within middleware. A dedicated UI is provided for creating and managing chaos experiments, defining ideal system behavior, control/treatment groups, and failure configurations. The post emphasizes the benefits of controlled experimentation for verifying system resilience and identifying potential issues before they cause outages.