How to Read Data into GPU Memory in Python with NVIDIA GPUDirect Storage | NVIDIA Technical Blog

This post introduces NVIDIA KvikIO, a Python and C++ library that provides high-level interfaces to NVIDIA GPUDirect Storage (GDS) for accelerated file I/O directly into GPU memory. It details how KvikIO leverages cuFile to bypass CPU staging and reduce CPU utilization, and provides a step-by-step tutorial on configuring KvikIO, reading a file into GPU memory, and verifying that the accelerated GDS path was activated using cuFile statistics. It also discusses runtime settings and system prerequisites for GDS.