118 million queries per second on Neki

This post details a benchmark run of Neki, achieving 118.5 million QPS across 512 shards and 1.22 PiB of data. It highlights linear scalability, with each shard sustaining over 200k QPS and reaching 231k QPS with headroom. The benchmark involved read-only, single-shard point selects with no writes, joins, or cross-shard queries. Key metrics include p99 latency of 6.06ms at the router and 13.95ms at the client, 67 errors per second (1 in 1.8 million queries), 15.8M read IOPS, and over 2 Tb/s network throughput. The run used primary-only shards without replicas and did not involve failovers during the measured window.