Project GameFace makes gaming accessible to everyone- Google Developers Blog
Jun 12, 2023Avneet Singh, Sisi Jin, Lance Carr

Summary
This post details the technical implementation of Project Gameface, an open-source, hands-free gaming mouse that uses head movement and facial gestures for cursor control and mouse/keyboard actions. It leverages MediaPipe's Face Landmarks Detection API with blendshape output to infer facial expressions and map them to actions. The project addresses challenges like cursor jitteriness with adjustable smoothing and allows for customizable gesture-to-action bindings. It also details the use of PyAutoGUI for mouse control, PyDirectInput for keyboard control, PyInstaller for packaging, and CustomTkinter for the UI.
More from the Coral Edge AI Platform trail
- ML Drift: Next-Gen GPU AI/ML Inference at the Edge- Google Developers Blog
- Bring multimodal semantic search to the edge with EmbeddingGemma 2- Google Developers Blog
- EmbeddingGemma 2: The Developer Guide- Google Developers Blog
- Mastering Edge AI on Raspberry Pi with LiteRT and Gemma- Google Developers Blog
- LiteRT.js, Google's high performance Web AI Inference- Google Developers Blog