Designing GPU-Accelerated Query Engines with NVIDIA GQE | NVIDIA Technical Blog

What this post added

This post introduces NVIDIA GQE (GPU Query Engine), a reference architecture for executing SQL queries on large datasets using modern NVIDIA hardware. It details GQE's three-layer architecture (query, data, execution) and its reliance on cuDF and other CUDA-X libraries. Key technical contributions include: 1. Optimized in-memory table layout with row groups and non-contiguous columnar partitions for efficient transfer. 2. Pipelined host-to-device transfer orchestration that overlaps scheduling, H2D transfer, decompression, and CUDA kernel execution across concurrent streams. 3. Data transfer optimizations through compression using NVIDIA nvCOMP (Cascaded and LZ4 algorithms) and dedicated Blackwell Decompression Engine, and aggressive partition pruning using zone maps. These techniques collectively achieve a 7.5x aggregate speedup over state-of-the-art CPU databases on TPC-H SF1000.