CUDA Toolkit 13.4 Adds Windows on Arm Support and Greater Control over Shared GPUs | NVIDIA Technical Blog

CUDA Toolkit 13.4 adds support for Windows on Arm, extending CUDA application development beyond Linux on Arm platforms. It provides preview functional support for the NVIDIA Rubin architecture (compute capability 107). Multi-Process Service V3 introduces a modernized control layer with a scriptable CLI, named server instances, TOML configuration, and cgroup-integrated GPU memory limits for precise GPU partitioning. CUDA Compute Fabric Transport (CFT) offers a transport-centric API for communication-library developers to move data across NVLink fabric. CUDA Python expands with cuda.core 1.1.0 adding texture and surface programming, NUMA-aware managed memory, and .pyi type stubs, while cuda.compute 1.1 enables ahead-of-time compilation of CCCL algorithms. CCCL 3.4 delivers faster warp-specialized cub::DeviceScan on Blackwell GPUs, single-call APIs across CUB device-wide algorithms, batched warp reductions, and C++ Standard Library parallel algorithms in cuda::std. The release also decouples the CUDA driver from the toolkit and defaults to Coherent Driver-based Memory Management on coherent platforms.
More from the CUDA Toolkit Enhancements trail
- Translating CUDA Tile Operations from Python to Rust Using Agentic AI | NVIDIA Technical Blog
- Introducing CUDA Rust: Two Tracks for Writing GPU Kernels | NVIDIA Technical Blog
- The Modern CUDA Toolbox in Practice: A Step-by-Step Optimization Walkthrough | NVIDIA Technical Blog
- CUDA Python 1.0: Stable APIs, One Foundation, Full Platform Access | NVIDIA Technical Blog
- Kernel Fusion in NVIDIA CUDA: Optimizing Memory Traffic and Launch Overhead | NVIDIA Technical Blog