The project allows a single user to create music through gestures using the Kinect v2 and Ableton Live. The system supports MIDI note generation, looping, partitioning the physical space for control of up to four separate instruments at once, and more, allowing for a user to build their own virtual band.
This project requires the following:
- Windows 8 or 10
- Kinect for Windows SDK 2.0
- Visual Studio
- Ableton Live
- Max for Live
- Kinect v2
Unfortunately, the project is sensitive to the requirements of the Kinect SDK and may not run on all devices. Tested using Visual Studio 2013 and 2015.
- Clone the repository to your local machine
- Copy Other/LooperOSC/midifile.class to
<Max_Directory>/Max/Cycling '74/java/classes - Alternatively, you can copy it to another directory and add the line
max.dynamic.class.dir <path_to_class>to<Max_Directory>/Max/Cycling '74/java/max.java.config.txt - Copy Other/LooperOSC/OSC-route.mxe to
<Max_Directory>/Max\Cycling '74\max-externals - You also need to install Emgu CV. You may have to copy some of the dll's to your build/bin directory in order for calibration to work.
The [test project](Other/test Project/test.als) should be configured and ready to go, so start the Kinect app and the Ableton file, step back and enjoy!
The 3D projection controls can be a bit confusing at first. The goal is align the camera such that the projection screen is displaying a non-distorted representation of the stage area. The camera is used to estimate the projector's pose.
The WASD controls are used to move the camera location along the X and Y planes, Q and E raise and lower the camera, and the middle mouse click can be used to adjust the look direction.
- Version 2.0 demonstration: https://www.youtube.com/watch?v=5LAG0SH2lwg
- Version 1.0 demonstration: https://www.youtube.com/watch?v=NU2ZUjyDzuI
For more information, please see the Documentation folder.