Cerebras

Introduces LongCePO (Long-Context Cerebras Planning and Optimization), an extension of the CePO framework. LongCePO enables LLMs to effectively manage and process information beyond their inherent context windows by employing strategic planning and iterative steps to access and integrate relevant information from extended data sources. This allows for "infinite context" at inference time, achieving frontier-level performance on long-context tasks (e.g., LongBench v2) with limited model context windows (~8K tokens), and outperforming models like Mistral-Large-Instruct-2411 and o1-mini-2024-09-12. The framework will be open-sourced.