CCCL Runtime: A Modern C++ Runtime for CUDA | NVIDIA Technical Blog

What this post added

Introduces the CCCL runtime, a new set of idiomatic C++ APIs for CUDA 13.2 that implement core CUDA functionality such as stream management, memory allocation, and kernel launches. It contrasts with the traditional CUDA runtime API by using dedicated types (e.g., `cuda::device_ref`, `cuda::stream`) instead of raw identifiers, making dependencies explicit and improving composability. The CCCL runtime also introduces owning types and non-owning `_ref` types (e.g., `cuda::stream` and `cuda::stream_ref`) to manage resource lifetimes and facilitate interoperability with existing code. The post provides a `vectorAdd` example demonstrating these new APIs, highlighting the benefits of explicit device association for streams and the use of memory pools for allocation.