← All stages

Week 2

Hands, face and a pinch you can see

Everything runs in the browser from a normal laptop webcam: face mesh, both hands, a live pinch meter and a cursor that follows the pointing hand.

In this clip

  • Face mesh and head direction
  • Both hands tracked, each labelled left or right, even when they cross
  • Pinch detection with a live thumb-to-index meter, so a click only fires when the fingers actually meet
  • Every finger followed on its own, plus a fist to clutch and two open palms
  • A cursor that follows whichever hand is pointing
  • About 50 ms from the camera frame to the gesture

No camera frames leave the laptop. The tracking runs locally; only the gesture events reach the app.