Tensor parallelism

7 posts · 5 sources

GoogleBlog26 Aug

Enterprise-Grade Precision for Long-Context Multimodal Embedding Inference on Cloud TPU- Google Developers Blog

NVIDIABlog6 Jul

Enhancing Goodput in Large-Scale LLM Training with Nonuniform Tensor Parallelism

CoreweaveBlog20 May

BasetenBlog12 Nov

Kimi K2 Thinking at 140+ TPS on NVIDIA Blackwell

MetaBlog17 Oct

Scaling LLM Inference: Innovations in Tensor Parallelism, Context Parallelism, and Expert Parallelism

BasetenBlog29 Apr

Day zero benchmarks for Qwen 3 with SGLang on Baseten

BasetenBlog13 Feb

How multi-node inference works for massive LLMs like DeepSeek-R1