Self-Compacting Language Model Agents

Introduces SELFCOMPACT, an inference-time scaffold for LLM agents that enables adaptive context compaction. It pairs a compaction tool with a rubric to determine when and how to summarize accumulated context, reducing stale content and outgrowing context windows. This method achieves competitive or improved performance on benchmarks with significantly lower token costs compared to fixed-interval summarization or no summarization.