tuiokinect

A simple TUIO hand tracker for Kinect

TuioKinect tracks simple hand gestures using the Kinect controller and sends control data based on the http://www.tuio.org/'>TUIO protocol. This allows the rapid creation of gesture enabled applications with any platform or environment that supports TUIO. Check out this extensive list of TUIO enabled software for further information: http://www.tuio.org/?software

http://www.youtube.com/watch?feature=player_embedded&v=vZSEEnMP6pg' target='_blank'>http://img.youtube.com/vi/vZSEEnMP6pg/0.jpg' width='425' height=344 />


Note: This is a preliminary proof of concept implementation, which still needs several improvements to become fully usable. Nevertheless it should work out of the box with most TUIO client applications.

Configuration: You can adjust the near/far threshold using the -/+ and keys.

Todo:

  • improve calibration by defining an active plane/region in 3D space rather than using two simple distance thresholds
  • color/depth calibration to enable more detailed segmentation of the hands
  • open/closed/pointing hand recognition to distinguish dedicated tracking modes.
  • create a windows project and binaries
  • create a osx 10.5 universal binary

    Acknowledgments: This application has been created by http://modin.yuri.at'>Martin Kaltenbrunner at the http://www.interface.ufg.ac.at'>Interface Culture Lab. It is based on http://www.openframeworks.cc'>OpenFrameworks and its http://github.com/ofTheo/ofxKinect'>ofxKinect example, which is integrating https://github.com/OpenKinect/libfreenect'>libfreenect by the http://openkinect.org/'>OpenKinect project. Many thanks to all the developers involved in the process, without their work this application wouldn't have been that easy to implement.

    In order to compile this application you will need a working installation of OpenFrameworks and the ofxKinect extension. The provided binary has been compiled and tested under Mac Os 10.6 on an Intel machine only.

    •

    Project Information

    • License: GNU GPL v2
    • 81 stars
    • svn-based source control

    Labels:
    Kinect TUIO Interactive OpenFrameworks Hand Gesture