Arbitrage: Efficient Reasoning via Advantage-Aware Speculation

Introduces ARBITRAGE, a step-level speculative generation framework for LLMs that uses a lightweight router to dynamically route generation based on the relative advantage between draft and target models, approximating an ideal ORACLE for near-optimal efficiency-accuracy trade-offs and reducing inference latency by up to 2x at matched accuracy.