Introducing Condor Galaxy 1: a 4 exaFLOPS Supercomputer for Generative AI - Cerebras

This post introduces Condor Galaxy 1 (CG-1), a 4 exaFLOPS, 54 million core AI supercomputer built in partnership with G42. CG-1 is the first in a series of nine supercomputers planned, totaling 36 exaFLOPS. It leverages Cerebras Wafer-Scale Cluster technology, connecting up to 192 CS-2 systems as a single logical accelerator, and weight streaming for data parallelism. CG-1 features 82 terabytes of memory, supports up to 100 trillion parameters, and natively handles 50,000-token sequence lengths. The system is available via Cerebras Cloud and G42 Cloud, offering a simplified programming model for large model training.