Shaping the future of AI interaction by reimagining the mouse pointer
May 12, 2026Adrien Baranes and Rob Marchant
Summary
This post details the principles and experimental demos of an AI-enabled pointer powered by Gemini. It outlines four interaction principles: maintaining user flow, 'show and tell' context capture, using natural shorthand ('this' and 'that'), and transforming pixels into actionable entities. The work is being applied to Chrome and Googlebook.