NVIDIABlog25 JunScaling AI Inference Across Multiple GPUs Using NVIDIA TensorRT with Multi-Device Inference Support
MetaBlog17 OctScaling LLM Inference: Innovations in Tensor Parallelism, Context Parallelism, and Expert Parallelism