Open-sourcing foundational tools for AI performance

What this post added

This post introduces and open-sources QNNPACK and FBGEMM, two high-performance kernel libraries designed to accelerate AI model inference on mobile devices and servers. QNNPACK focuses on optimizing computer vision models for mobile, while FBGEMM speeds up server-side operations for language translation, recommendation systems, and text understanding. Both libraries leverage low-precision integer arithmetic for inference, reducing computational overhead without significant accuracy loss, and are deployed in production at Facebook.