Compose a melody with your hand

You draw the shape; the model fills in the notes.

1. 01
   Move with the beat

   Raise or lower one finger in front of your camera, or move your mouse, while a metronome ticks.

2. 02
   Each beat becomes a gesture

   How far you moved since the last beat is recorded: up, down or hold, in three sizes.

3. 03
   The model writes a melody

   A diffusion model writes a four-bar melody whose pitch follows the shape you drew.

Uses your camera for hand tracking, which runs in your browser; video never leaves your device. Works best in good light. Turn your sound on for the metronome and playback.