Project Gameface launches on Android- Google Developers Blog
May 14, 2024Avneet Singh, Glenn Cameron

Summary
This post details the open-sourcing of Project Gameface for Android, an accessibility tool that allows users to control an Android device's cursor using head movements and facial gestures. It leverages MediaPipe's Face Landmarks Detection API (specifically 52 face blendshape values) and the Android Accessibility Service to translate facial expressions into cursor control and mobile actions (e.g., GLOBAL_ACTION_HOME, GLOBAL_ACTION_BACK). The implementation includes a floating camera feed for gesture visualization and a custom drag function that lacks a straightforward method in the current Android accessibility service.
More from the Android Accessibility and Developer Tools trail
- What’s new in Chrome OS? A faster, simpler, and more secure environment for Web and Android developers- Google Developers Blog
- Travel through space with the Project Tango app, Solar Simulator - Google Developers Blog
- EarlGrey - iOS Functional UI Testing Framework- Google Developers Blog
- New in Android Samples: Authenticating to remote servers using the Fingerprint API- Google Developers Blog
- Google Fit SDK available now- Google Developers Blog