How we built the new fastest API for GLM-5.2

What this post added

This post details the development of a new, significantly faster API for the GLM-5.2 model, achieving 601 tokens per second. It introduces a 'GLM-5.2-Fast' API that prioritizes latency over throughput by using Tensor and Expert Parallelism instead of Attention Data Parallelism, and reducing the max batch size. The post also mentions general optimizations to the scheduler, NVFP4 weights, speculative decoding profiles, and bug fixes in the inference engine.