When "Performance" Means Two Different Things
Mar 3, 2026Noah Rizika, Lea Wang-Tomic
Summary
Introduces the concept of two distinct types of performance in AI applications: infrastructure performance (latency, throughput, cost) and result quality (accuracy, precision, relevance). Details metrics for each type and provides an example of how optimizing one can negatively impact the other. Argues for independent measurement and optimization of both.