Anthropic is developing and iterating on methods to enhance the robustness of AI models, particularly Claude, against prompt injection attacks, especially in browser-based agent scenarios. This involves improving model training, classifier accuracy, and expert human red teaming to mitigate risks associated with untrusted web content. The goal is to enable AI agents to perform high-value tasks safely and reliably, even when interacting with the internet.
All Anthropic trails