Code
There are two ways to use the tryplex toolkit. With Synapse you're able to get it running within a few minutes. If you like to use OSCeleton, the installation procedure takes about two hours to complete.
Synapse
- Single skeleton tracking
- Depth image
- Works without installing drivers etc.
OSCeleton
- Track up to 6 users
- Lower cpu usage
- Is a bit more responsive
Running tryplex with Synapse
- Place the plugins from 'QC Plug-ins/Quartz Composer Plug-Ins' in your '/Library/Graphics/Quartz Composer Plug-Ins' folder
- Place the plugins from 'QC Plug-ins/Quartz Composer Patches' in your '/Library/Graphics/Quartz Composer Patches' folder
- If these folders don't exist, make them
- To install the macro's in your library place them in the /library/graphics/Quartz Composer Patches/ folder.
- Connect your Kinect, and run Synapse from the 'Synapse' folder.
- Open and run '01_01s single skeleton.qtz' from the 'QC/ macros sample compositions Synapse' folder.
- Stand and hold in the cactus position to calibrate.
NOTE: this installation guide is probably outdated.
Check http://www.codingcolor.com/featured-articles/set-up-kinect-on-osx-10-8-mountain-lion/ for a more up to date guide!
Insalling for use with OSCeleton
Installing Xcode, Libtool, Macports, LibUSB, OpenNI, primesense NITE, avin2/sensorkinect, qcOSC
This is the fast route to install OSCeleton to use with Quartz Composer.
We did our best to document it, at the bottom of this page you'll find common error's people encountered. Note that this is quite a tedious operation, it takes some time and patience. Previous installs of kinect/openNI related software could influence the success rate of a installation, so preferably use a clean system with only Xcode and Snow Leopard. Start only if you have some basic knowledge of using the terminal and Quartz Composer.
Things definitely will get easier in the future, but for now it's all new and still in development by a lot of parties.
The installation should take 1 or 2 hours to complete.
For this to work I've used the processing sample to reroute the osc messages into a format that quartz could read.
In this setup I'm still using the 11/1/2010 build of OSCeleton, it seems to be the most reliable version for osx at the moment. There's a https://github.com/Sensebloom/OSCeleton'>newer version (with QC OSC support!) but I still get segmentation errors sometimes and jerky knee/feet data with that version. When there's a more stable build of OSCeleton I'll update this page and the source.
Step 1 - Xcode
Download and install this:
Xcode (get a membership first, it's free)
http://developer.apple.com/devcenter/mac/index.action'>http://developer.apple.com/devcenter/mac/index.action'>http://developer.apple.com/devcenter/mac/index.action
https://developer.apple.com/ios/download.action?path=/ios/ios_sdk_4.2__final/xcode_3.2.5_and_ios_sdk_4.2_final.dmg'>https://developer.apple.com/ios/download.action?path=/ios/ios_sdk_4.2__final/xcode_3.2.5_and_ios_sdk_4.2_final.dmg'>https://developer.apple.com/ios/download.action?path=/ios/ios_sdk_4.2__final/xcode_3.2.5_and_ios_sdk_4.2_final.dmg
NOTE: Xcode 4 is only free when you are enlisted in the developer program, else available for $4.99 in the app store. The Xcode 3.2.5 download link provided still works if you register at the developer page without a paid subscription.
Step 2 - Macports
Macports
http://distfiles.macports.org/MacPorts/MacPorts-1.9.2-10.6-SnowLeopard.dmg'>http://distfiles.macports.org/MacPorts/MacPorts-1.9.2-10.6-SnowLeopard.dmg'>http://distfiles.macports.org/MacPorts/MacPorts-1.9.2-10.6-SnowLeopard.dmg
Step 3 - Libtool
Libtool
open the terminal and type:
sudo port install libtool
and press enter
http://www.oneseconds.com/dev/images/libtool.png' />
if it doesn't work, restart your terminal program and try again
If during the install it gives this error:
Error: db46 requires the Java for Mac OS X development headers.
Error: Download the Java Developer Package from:
Error: Target org.macports.configure returned: missing Java headers
Error: Failed to install db46
Then Install this package first:
https://connect.apple.com/cgi-bin/WebObjects/MemberSite.woa/wa/getSoftware?bundleID=20719'>https://connect.apple.com/cgi-bin/WebObjects/MemberSite.woa/wa/getSoftware?bundleID=20719'>https://connect.apple.com/cgi-bin/WebObjects/MemberSite.woa/wa/getSoftware?bundleID=20719
The latest OSX doesn't include the Java for Mac OS X development headers annymore standard.
Step 4 - LibUSB
LibUSB
In the terminal type:
sudo port install libusb-devel +universal
and press enter
http://www.oneseconds.com/dev/images/libusb.png' />
Important note: Put the following installation files (openNI, NITE and avin2/sensorkinect) inside a folder that doesn't contain spaces or weird characters, else it'll generate errors during installation! Leave the folder names of openNI, NITE and avin2/sensorkinect intact.
Step 5 - OpenNI
Download the 'OpenNI Unstable Build for MacOSX 10.6 Universal x86/x64 (32/64-bit)' from: http://www.openni.org/downloadfiles/opennimodules/openni-binaries/20-latest-unstable'>http://www.openni.org/downloadfiles/opennimodules/openni-binaries/20-latest-unstable'>http://www.openni.org/downloadfiles/opennimodules/openni-binaries/20-latest-unstable and expand the files.
http://www.oneseconds.com/dev/images/openni.png' />
In the terminal go to the OpenNI directory (the easy way: type 'cd ' and drag and drop the directory from the finder and press enter) and type: sudo sh install.sh
and press enter
Step 6 - PrimeSense NITE
Download the 'PrimeSense NITE Unstable Build for for MacOSX 10.6 Universal x86/x64 (32/64-bit)' from: http://www.openni.org/downloadfiles/opennimodules/openni-compliant-middleware-binaries/33-latest-unstable'>http://www.openni.org/downloadfiles/opennimodules/openni-compliant-middleware-binaries/33-latest-unstable'>http://www.openni.org/downloadfiles/opennimodules/openni-compliant-middleware-binaries/33-latest-unstable and expand the files.
http://www.oneseconds.com/dev/images/primesense.png' />
Now in the terminal go to the NITE directory (the easy way: type 'cd ' and drag and drop the directory from the finder and press enter) and type:
sudo sh install.sh
and press enter
use 0KOIk2JeIBYClPWVnMoRKn5cdY4= as licence key (and yes, include the '=' sign!)
Step 7 - avin2/sensorkinect
Download the avin2/sensorkinect drivers at:
https://github.com/avin2/SensorKinect'>https://github.com/avin2/SensorKinect'>https://github.com/avin2/SensorKinect and expand the files.
Navigate to the avin2/bin folder and expand the 'SensorKinect-Bin-MacOSX-v5.0.3.4.tar.bz2' file.
In the terminal, go to the avin2/bin/SensorKinect-Bin-MacOSX-v5.0.3.4 folder and type:
sudo sh install.sh
Step 8 - qcOSC/kineme structure maker
Place the plugins from 'QC Plug-ins/Quartz Composer Plug-Ins' in your '/Library/Graphics/Quartz Composer Plug-Ins' folder
Place the plugins from 'QC Plug-ins/Quartz Composer Patches' in your '/Library/Graphics/Quartz Composer Patches' folder
If these folders don't exist, make them
If you've completed installation procedure, and it's working it's time to play!
Running
First of all, Quartz Composer should be in 32-bit mode. To do this, locate the Quartz Composer app in the Developer/Applications folder and press CMD+I when selected. Now select 32-bit mode.
http://www.oneseconds.com/dev/images/32bit.png' />
To run
http://www.youtube.com/watch?feature=player_embedded&v=i5QhYgUh6ck' target='_blank'>http://img.youtube.com/vi/i5QhYgUh6ck/0.jpg' width='425' height=344 />
Connect the kinect
Open a terminal window and drag and drop osceleton from the 'OSCeleton and sendOSC' folder in the tryplex toolkit to the terminal window (opening from the finder doesn't work!!) and press enter
Start the application sendosc from the 'OSCeleton and sendOSC' folder in the tryplex toolkit by double clicking
open '01 01s_single_skeleton' from the 'QC' folder in quartz composer
http://www.oneseconds.com/dev/images/calibrationpose.png' />
To calibrate the kinect should have a clear view and you have to stand in front of it with both arms stretched and the upper-arms at 90 degrees. After a second or so it should work and you can move freely!
If it fails, reposition yourself a bit more to the front/back/left and try again
It's best to open en play around with the examples in the numbered order, so you'll get an idea of how all patches work.
To install the macro's in your library place them in the /library/graphics/Quartz Composer Patches/ folder. Quit and restart QC to activate them.
QCosc can't open the same port twice so when you open a second composition it gives an error: 'Error opening socket on specified port. Please choose a different port.'.
Quit and restart QC and open the composition again, and it'll work. Once a new version of OSCeleton will be around this error will be gone.
For questions, error's suggestions, please report to the discussion group!.
Common errors people encountered
http://www.oneseconds.com/dev/images/portproblem.jpg' />
Error on opening socket at specified port
qcOSC can't open two the same OSC ports at one time. This happens when you open a second composition with the OSC receiver in it. To fix quit and restart QC, and open one composition at the same time.
Segmentation fault
either you're using the latest osceleton build (this error pops up now and then, but in between it works). Or the camera is used by another application, close any open programs and the terminal, disconnect and reconect the kinect. If it still fails, try reinstalling from the begin.
Image not found/bus error
Maybe the camera is used by another application, close any open programs and the termincal, disconnect and reconnect the kinect. Or libusb is not installed (correctly) uninstall and reinstall by opening a new terminal window and type: sudo port uninstall libusb-devel and then:
sudo port install libusb-devel +universal
Restart your terminal program and try again. If it still fails, try reinstalling from the begin.
Quartz composer closes/crashes when opening an example
Maybe Quartz isn't in 32-bit mode yet. Locate the Quartz Composer app in the Developer/Applications folder and press CMD+I when selected. Now select 32-bit mode.
During installation: Command not found, No such file directory
and when trying to run:
Library not loaded: ../../Bin/Release/libOpenNI.dylib
Referenced from: /Users/blumBlum/Desktop/OPENNI_FOR_QUARTZ/OSCeleton
QC toolkit v0.1/OSCeleton and sendOSC/osceleton.app
Reason: image not found
Trace/BPT trap
Check if the OpenNI/Nite/avin2 installation files you downloaded are nested in a directory with spaces. If they are, put them in a folder without any spaces or unusual characters and repeat the installation procedure.
"StructureTools.plugin" is not a valid Quartz Composer plug-in etc.
If you get something like this:
QCPlugIn: Bundle at path "/Library/Graphics/Quartz Composer Plug-Ins/
StructureTools.plugin" is not a valid Quartz Composer plug-in
:
Patch with name "StructureMaker:KinemeNamedStructureMaker" is missing
Macro Patch
Cannot create node of class "StructureMaker" and identifier
"KinemeNamedStructureMaker"
The Structuremaker plugin is either not there or at the wrong place.
The Structure maker plug in should be in the /Library/Graphics/Quartz Composer Patches folder
If that folder doesn't exist, make it and place it there.