CePO: Empowering Llama with Reasoning using Test-Time Compute - Cerebras

Introduces CePO (Cerebras Planning and Optimization), a framework that enhances Llama models with reasoning capabilities via test-time computation. CePO enables Llama 3.3-70B to surpass Llama-3.1 405B in accuracy on coding, math, and reasoning benchmarks, achieving ~100 tokens/second on Cerebras hardware. The framework's pipeline includes step-by-step planning, multiple response generation, inconsistency analysis, and a Best-of-N selection with confidence scoring. CePO is compared against CoT with Reflection, Self-Consistency, and Best-of-N prompting strategies, demonstrating consistent improvement across various tasks.