Sign Language Interface with MediaPipe
Project GameFace makes gaming accessible to everyone- Google Developers Blog

Project GameFace makes gaming accessible to everyone- Google Developers Blog

6/12/2023 · Avneet Singh, Sisi Jin, Lance Carr

What this post added

Introduced Project Gameface, an open-source, hands-free gaming mouse utilizing MediaPipe's Face Landmarks Detection API with blendshape output. Detailed the use of forehead landmarks for cursor movement, separate cursor speed adjustment for different directions, and adjustable cursor smoothing to combat jitter. Explained the customization of facial expressions for mouse actions (click, scroll, reset cursor) and keyboard presses. Described the gesture size feature for triggering actions based on expression intensity. Highlighted the use of PyAutoGUI for mouse control, PyDirectInput for keyboard control, PyInstaller for packaging, and CustomTkinter for the UI.

Read the original post ↗