Privileged Bases in the Transformer Residual Stream

This post investigates the phenomenon of privileged bases in the Transformer residual stream, which contradicts the mathematical theory suggesting arbitrary basis directions. The authors provisionally conclude that per-dimension normalizers in the Adam optimizer are the cause, ruling out Layer Normalization and finite-precision floating-point calculations as culprits.