Shared network vulnerability disclosure
May 23, 2024

Summary
This post details a security vulnerability where model containers could eavesdrop on internal traffic due to shared network namespaces and unencrypted communication between model containers and their 'director' processes. The vulnerability was mitigated by dropping NET_ADMIN and NET_RAW capabilities from model containers, preventing privileged network access, and by encrypting all internal TLS traffic between model pods and Replicate's internal networks.