Can you teach an algorithm to dance?
Double Agent is an interactive dance piece built by Simon Biggs for an exhibit at MOD. from May - October 2018.
The exhibit is in two parts - a pre-trained Machine Learning algorithm that generates artificial human skeletons based on hundreds of hours of training watching professional dancers.
The second part is a live interactive display, using a Kinect 2 sensor to detect live skeletons of people dancing in front of it.
Read more: mod.org.au/double-agent
Or visit Double Agent at MOD..
The software was written by Simon Biggs using the Processing.org framework.
There are three Processing sketches to run Double Agent.
- Kinect2UDP - sensor to detect live skeletons, and a UDP server to send the skeleton data to another computer to display the data.
- DoubleAgent 1* - projection app showing the machine learning data.
- DoubleAgent 2* - projection app showing the live data.
*The third party library PJBullet.jar, used to 'wrap' jbullet.jar for Processing, isn’t included here. Rather than posting non-functional code the example sketch features Double Agent’s functionality for acquiring live Kinect V2 skeleton data from the Kinect2UDP app (running in Windows 8 or 10) over UDP (ethernet) for instantiating and visualising up to six user skeletons (in Processing 2.2.1 in Mac OS X).
Kinect2UDP_Receiver - Processing app for MacOS to receive Kinect V2 data from Windows computer running the Kinect2UDP app over UDP.
Simon Loffler designed a plinth to house the Kinect 2 sensor and micro-pc to run the Kinect 2 UDP processing sketch.
- kinect-plinth has the SketchUp files to build your own out of 10mm MDF.
- Install SketchUp, and then open
MOD_Double_Agent_Plinth.skp.
- Artist & Programmer: Simon Biggs
- Machine Learning developer: Samya Bagchi
- Choreography: Sue Hawksley and Tammy Arjona
- Project management: MOD. (Simon Loffler)
Released under an MIT License.
Copyright (c) 2018 MOD.