CCCL Runtime: A Modern C++ Runtime for CUDA | NVIDIA Technical Blog

This post introduces the CCCL runtime, a new set of idiomatic C++ APIs available starting in CUDA 13.2 that implement core CUDA functionality: stream management, memory allocation, kernel launches, and more. It contrasts with the traditional CUDA runtime API by using dedicated types (e.g., `cuda::device_ref`, `cuda::stream`) instead of raw identifiers, making dependencies explicit and enabling local reasoning. It also introduces owning types (e.g., `cuda::stream`) and non-owning reference types (e.g., `cuda::stream_ref`) for resource management, following the `std::string` and `std::string_view` pattern, and discourages the use of the default stream by not exposing it in the API.