Claude does cyber competitions

This post details Anthropic's experience entering Claude into various cybersecurity competitions (CTFs, CCDC) to evaluate its capabilities. It highlights Claude's performance metrics across different competition types, its speed in solving challenges, and its autonomous operation using tools. The post also discusses failure modes encountered, such as context window limitations and the impact of environmental factors, and the mitigation strategies employed (e.g., recursive summarization). It emphasizes the importance of providing AI agents with appropriate tools and agentic personas for complex, long-duration tasks in adversarial environments.