Cyber toolkits for LLMs
Jun 13, 2025

Summary
This post details research into equipping LLMs with cyber toolkits like Incalmo, enabling them to plan and execute complex multistage cyber attacks. It demonstrates how these toolkits translate LLM thoughts into specific computer commands, leading to significant success rates in simulated network compromises. The research highlights the potential for LLMs to lower barriers to entry for cyber attacks and automate defensive workflows, while also noting the need for further research into actively defended networks and fine-tuning.
More from the AI Code Generation and Software Engineering Agents trail
- Using Claude Science to produce the first complete map of the sky in UV light
- Project Swap: What happens when agents trade for us?
- Automated researchers can reliably mitigate alignment failures
- How Claude is accelerating protein design and analytical chemistry
- Patterns and problems in multiagent systems