Announcing the Cerebras Architecture for Extreme-Scale AI - Cerebras

Introduces the Cerebras architecture for extreme-scale AI, featuring disaggregated memory and compute. Key components include MemoryX for off-chip weight storage and streaming, SwarmX for efficient inter-CS-2 system communication enabling near-linear scaling, and fine-grained dataflow scheduling for accelerating sparse neural networks. This architecture allows for models up to 120 trillion parameters and clustering up to 192 CS-2 systems.