Outlier Token Control in Diffusion Transformers

This post introduces Dual-Stage Registers (DSR) as a method to control outlier tokens in Diffusion Transformers (DiTs) for image generation. DSR is applied to both the encoder and denoiser components, utilizing trained registers when available and recursive test-time registers otherwise. This approach aims to reduce outlier artifacts and improve generation quality across various image generation tasks.