Project Gameface launches on Android- Google Developers Blog

What this post added

Project Gameface has been launched on Android, making its hands-free cursor control technology available for Android applications. This involves using the Android Accessibility Service to create a virtual cursor and leveraging MediaPipe's Face Landmarks Detection API, specifically its 52 face blendshape values, to map facial expressions and head movements to cursor control and actions. The implementation supports mobile actions like GLOBAL_ACTION_HOME, GLOBAL_ACTION_BACK, GLOBAL_ACTION_NOTIFICATIONS, and GLOBAL_ACTION_ACCESSIBILITY_ALL_APPS. A drag function has been implemented using the Android Accessibility Service to allow users to define start and end points for dragging actions. The camera feed is integrated to provide user feedback and maintain overlay visibility across the Android OS.