Continuous Load Testing

This post details the implementation of continuous load testing by ensuring clients (Koi Pond) are always running in Kubernetes pods. It introduces safety features like Automatic Shutdown (using Trickster and Prometheus metrics to halt tests if thresholds are breached) and an enhanced Emergency Stop service. For resilience, Koi Pond's state is now persisted in DynamoDB, and token generation has been automated using a cron job, a job queue, and encrypted S3 storage with retries. The rollout involved collaboration with infrastructure teams and a gradual ramp-up.