veremin
a video theremin based on PoseNet
loading...

ibm.biz/veremin

veremin qr code

Veremin

A video theremin that allows you to make beautiful music just by waving your arms!

Usage

After the video loads, it will include an overlay with skeletal and joint information detected by PoseNet. The overlay also include two adjacent zones/boxes. Move your wrists within each of the zones to make sounds.

Move your right hand/arm up and down (in the right zone) to generate different notes.

Move your left hand/arm left and right (in the left zone) to adjust the velocity of the note.

Requirements

At a minimum, your browsers must allow access to a webcam and support the Web Audio API.

If your browser supports the Web MIDI API, you can connect a MIDI synthesizer to your computer or you can download and run a software synthesizer such as SimpleSynth.

Also, if you have access to a MQTT broker that supports WebSockets you can enable and publish the positional data to the broker for other devices or applications to subscribe to.

Depending on your browser, you may need to access this application using the https protocol instead of the http.

Check out the README for more information.

Environment

Environment