Attention Mechanisms

8 posts · 6 sources

NVIDIABlog1 Aug

Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference

Hugging FaceBlog6 Jul

Profiling in PyTorch (Part 2): From nn.Linear to a Fused MLP

Hugging FaceBlog6 Jul

Profiling in PyTorch (Part 3): Attention is all you profile

Together AIBlog11 May

Serving DeepSeek-V4: why million-token context is an inference systems problem

Hugging FaceBlog20 Jan

Differential Transformer V2

GoogleBlog30 Apr

Gemma explained: What’s new in Gemma 3- Google Developers Blog

CerebrasBlog11 Mar

Variable Sequence Length Training for Long-Context Large Language Models

MetaBlog11 Jul

Talk the Walk: Teaching AI systems to navigate New York through language