QNNPACK: Open source library for optimized mobile deep learning

What this post added

Introduced QNNPACK, a high-performance kernel library optimized for mobile AI, which speeds up operations like depthwise convolutions used in advanced neural network architectures. QNNPACK has been integrated into Facebook apps and deployed to billions of devices, outperforming state-of-the-art implementations by approximately 2x on benchmarks like quantized MobileNetV2. The library provides high-performance implementations of convolutional, deconvolutional, and fully connected operations on quantized tensors, addressing the need for efficient inference on mobile devices with limited computational power. It leverages a linear quantization scheme compatible with the Android Neural Networks API and is optimized for cases where panels of input matrices fit into L1 cache, fusing requantization and eliminating matrix repacking overhead.