Touch Music

​

Integrating the p5.sound and ML5 library for p5.js, I created Touch Music, a program that allows the user to make music with body gestures. The purpose of this project is to explore alternative ways to make music through introducing the latest interactive mechanisms and technologies. 

 

Seven colorful circles, each representing a musical note between C4 to B5, will appear on top of the live video. The built-in machine learning model, ML5 poseNet, tracks the user's left and right wrist positions and determines if they overlap with any of the circles. When the user "touches" one of the circles with their wrist, the corresponding monosynth note is generated through p5.sound.