Open-sourcing FBGEMM for state-of-the-art server-side inference

What this post added

Open-sourced FBGEMM, a high-performance kernel library for server-side inference, optimized for low-precision calculations. Achieved >2x performance gains in production by enabling efficient quantized inference on CPUs. FBGEMM supports native tensor formats and fuses operations to minimize overhead, contributing to significant speedups and reduced bandwidth usage in various AI services like translation, recommendation systems, and text understanding.