Skip to content
Gaming

Gesture-Controlled Game

Play a browser game with hand gestures via webcam.

Intermediate24h1–3 people16/20 fit
TL;DR

Build Gesture-Controlled Game for casual players and kids in ~24h with 1–3 people. Stack: JavaScript + MediaPipe + Canvas.

Why it wins: Physical and fun — great stage demo.

Build flow

01 · Problem
Kids sit still for hours playing games.
02 · Solution
Hand tracking turns gestures into game controls for an active, no-controller game.
03 · Build
  1. 1Hand landmarks
  2. 2Gesture classifier
  3. 3Canvas game loop
  4. 4Calibration screen
04 · Demo
Raise your hand to jump → character jumps on screen.

MVP checklist

  • Hand tracking
  • Gesture mapping
  • Simple runner game
  • Calibration

Tech stack

TechRole
JavaScriptGame / app logic
MediaPipePose / hand tracking
Canvas2D rendering

Reference repos

Open-source projects you can build on. Links checked 2026-10-31.

Related ideas

More Gaming

  • Gaming

    Jump Rope Counter Game

    Count jumps with the webcam and compete on streaks

    Beginner8h1
    MediaPipeJavaScript
    18/20

  • Gaming

    Rhythm Game from Any Song

    Upload a song and play a rhythm game generated from its beats

    Intermediate16h1–2
    Web AudioPhaserJavaScript
    17/20

  • Gaming

    Draw-to-Solve Physics Puzzles

    Draw shapes that become physical objects to guide a ball to the goal

    Intermediate16h1–2
    PhaserMatter.jsJavaScript
    17/20