MediaPipe · Proof of Concept

Control the big screen with your hand

No remote, no touchscreen. A webcam reads your hand and turns it into a cursor.

00

📷

Set up the camera

Position a webcam facing the room at roughly screen height, with nothing blocking the view. Make sure the room is well lit so your hand is clearly visible.

01

👆

Move the cursor

Straighten your index finger and keep the rest folded — the on-screen cursor follows your fingertip like a mirror. Keep your hand at a comfortable distance from the camera so it stays fully in frame.

02

👆⏱️

Hold to click

Once the cursor is over a control (the panels, buttons and bubbles), hold your point perfectly still for 3 seconds. You'll see a ring fill around the cursor, and when it completes, the item is clicked for you. A steady hand makes for a faster, more reliable click.

03

👍

Thumbs-up for guide

Show a thumbs-up with your other fingers tucked in to open or close this guide any time you need a reminder, without touching the screen or using a remote.