Emergent introspective awareness in large language models

This post presents research demonstrating emergent introspective awareness in large language models, specifically Claude. The core technical contribution lies in the experimental methodology: concept injection. This involves identifying neural activity patterns representing specific concepts (e.g., 'all caps') and injecting them into unrelated contexts to observe the model's reaction. The research found that models, particularly Opus 4 and 4.1, can recognize the presence of injected concepts internally, even before explicitly mentioning them. This is contrasted with previous activation steering techniques where awareness seemed to occur after the fact. The experiments also showed that models can confabulate reasons for pre-filled, nonsensical outputs by referring to their prior internal states, suggesting a check against internal 'intentions.' Furthermore, models demonstrated control over their internal representations when instructed or incentivized to think about specific concepts, showing increased neural activity. The post highlights failure modes, such as hallucination or failure to detect injections, and notes that introspection is unreliable and limited in scope compared to human introspection.