The libfreenect software includes all code necessary to activate, initialize, and communicate data with the Kinect hardware. This includes various drivers and a cross-platform API that functions on Windows, Linux, and OS X. The API will support bindings and extensions for the following languages/platforms: C, C++, .NET (C#/VB.NET), Java, Python, and C Synchronous Interface. The community is actively exploring the possibility of also exposing the API to OpenCV and MATLAB (both in progress by user Brandyn), AS3, Processing, and LabView (all in progress by user Ryan Gordon), and network sockets and data socket engineering.
Creating a multi-touch capable gamin surface for tabletop games supporting both real and virtual objects
The Kinect™ Multi-touch gaming table project explores the feasibility of using the Kinect™ to enhance the experience of table top gaming over a long distance. Unlike traditional software based implementations that offer a purely virtualized version of the game, the table is designed to accommodate the manipulation of both real and virtual objects. The sensor technology allows manipulation of these objects in a natural way, not mapped to buttons or keyboard commands. Combined with telepresence capabilities, the table can simulate a table top gaming environment akin to a tra
This work is part of the STARMAC Project in the Hybrid Systems Lab at UC Berkeley (EECS department). http://hybrid.eecs.berkeley.edu/Researcher: Patrick BouffardPI: Prof. Claire TomlinOur lab's Ascending Technologies  Pelican quadrotor, flying autonomously and avoiding obstacles.
Created an interactive puppet by using skeleton tracking on the arm and determining where the shoulder, elbow, and wrist is, using it to control the movement and posture of the giant funky bird! They have used openFrameworks and libFreenect
"Minority Report" inspired GUI. Tracks hands for natural real time interaction.
This is a graphical interface inspired by the movie "Minority Report". It uses the Kinect sensor from Microsoft, and the recently released libfreenect driver for interfacing with the Kinect in linux. The graphical interface and the hand detection software were written at MIT to interface with the open source robotics package 'ROS', developed by Willow Garage (willowgarage.com). The hand detection software showcases the abilities of the Point Cloud Library (PCL), a part of ROS that MIT has been helping to optimize.