ML Compute Cluster Infrastructure

Exa has deployed a new, large-scale GPU cluster (the Exacluster) to power its ML research and training workflows. This infrastructure is built using a five-layer stack: Pulumi for Infrastructure as Code, Ansible/Kubespray for bare-metal build automation, NVIDIA GPU/Network Operators for hardware management, Alluxio for a distributed high-throughput cache, and Flyte for workflow orchestration. This setup enables efficient training of large neural network models, including retrieval models and rerankers, and allows for rapid iteration and scaling of ML workloads.