Google

Project Gameface launches on Android- Google Developers Blog

May 14, 2024Avneet Singh, Glenn Cameron
Project Gameface launches on Android- Google Developers Blog
SummaryAI, from the source post

This post details the open-sourcing of Project Gameface for Android, an accessibility tool that allows users to control an Android device's cursor using head movements and facial gestures. It leverages MediaPipe's Face Landmarks Detection API (specifically 52 face blendshape values) and the Android Accessibility Service to translate facial expressions into cursor control and mobile actions (e.g., GLOBAL_ACTION_HOME, GLOBAL_ACTION_BACK). The implementation includes a floating camera feed for gesture visualization and a custom drag function that lacks a straightforward method in the current Android accessibility service.

More from the Android Accessibility and Developer Tools trail