Sorry, you need to enable JavaScript to visit this website.
Kinect@RIT

FAAST

FAAST is middleware to facilitate integration of full-body control with games and VR applications. The toolkit relies upon software from OpenNI and PrimeSense to track the user's motion using the PrimeSensor or the Microsoft Kinect sensors. FAAST includes a custom VRPN server to stream the user's skeleton over a network allowing VR applications to read the skeletal joints as trackers using any VRPN client. Additionally, the toolkit can also emulate keyboard input triggered by body posture and specific gestures. This allows the user to add custom body-based control mechanisms to existing off-the-shelf games that do not provide official support for depth sensors.

World of Warcraft with Microsoft Kinect using FAAST and OpenNI

Submitted by dcw4238 on Tue, 04/26/2011 - 11:06

We are developing the Flexible Action and Articulated Skeleton Toolkit (FAAST), which is middleware to facilitate integration of full-body control with games and VR applications. FAAST currently supports the PrimeSensor and the Microsoft Kinect using the OpenNI framework. In this video, we show how FAAST can be used to control off-the-shelf video games such as World of Warcraft. Since these games would not normally support motion sensing devices, FAAST emulates keyboard input triggered by body posture and specific gestures.

Middleware: 
OpenNI
Operating System: 
Windows
Tools: 
FAAST

Street Fighter IV Hack

Submitted by dcw4238 on Tue, 04/26/2011 - 10:58

Ever wanted to throw fireballs from you hands? Now you can. This setup uses a combination of FAAST for Kinect input and GlovePIE for the chuck and scripting of special moves. Probably the most interesting aspect of this is that you can play over the internet or LAN with your friends... Give it a shot and why not modify my scripts for some other characters?

Middleware: 
OpenNI
Operating System: 
None
Tools: 
FAAST
GlovePIE