They work together like ebony and ivory.
Using OpenKinect (drivers) + OpenCV (image processing and recognition) + FestVox (speech synthesis) + CMU Sphinx (speech recognition). Proof of concept. I'm wearing a headset because OpenKinect does not yet support audio input. All of the processing and recognition occurs in real time.Link: http://www.youtube.com/watch?v=fQ59dXOo63o
Takayuki Fukatsu hacked Kinect with openFrameworks with really impressive results, basically keeping the background over your image with great tracking of the background. Link: http://blog.artandmobile.com/2010/11/ar-optical-camouflage/
HMD is doing is rotating the camera angle based on the information, OpenNI only linked to the head of the joint inputs. Were able to build a virtual reality environment to be able to reflect movement of the body by itself without any special equipment. This is the second demonstration was held in Nagoya May 18, what you will be presented at the seminar, a video clip when I get a little plus. State that can be seen moving their limbs and face down a little. The scene is reflected in his non-action of his body, feeling very strange and interesting.
I've written a program that uses the Kinect 3D camera to take 3D snapshots which record the nearest object to the camera in each part of the image. By taking multiple 3D snapshots at different times and then merging them to show the closest object, I can create a 3D sculpture that you can walk through. This runs in real time, creating a fully interactive experience.
This uses OpenKinect with the python bindings to talk to light dimming hardware via E1.31/DMX via the OLA libraries from opendmx.net. I have a custom python library that handles the dimming etc. link: http://www.youtube.com/watch?v=Kg0Rvj-Seto
Ever wanted to throw fireballs from you hands? Now you can. This setup uses a combination of FAAST for Kinect input and GlovePIE for the chuck and scripting of special moves. Probably the most interesting aspect of this is that you can play over the internet or LAN with your friends... Give it a shot and why not modify my scripts for some other characters?