About

Sonic Gesture is a Computer Vision project where learned hand poses are translated into corresponding commands with the aim of generating sound. In other words this software makes it possible to create and manipulating sound without physical interaction with a computer.

This is the graduation project of Gijs Molenaar for the Master Artificial Intelligence at the University of Amsterdam. You can read the thesis if you want.

Installation

Please refer the installation manual if you want to try out Sonic Gesture. If you have questions or want to contribute please join the discussion list.

News

Friday 12th of December 2010

I managed to get Sonic Gesture compiling on Windows, and I made an installer. Tested on Windows 7 only. Download it now, and if it doesn't work please let me know.

Friday 26th of November 2010

1.0.0 has been released! Source tar ball and Ubuntu packages are available, windows and Mac OS X binaries are coming soon.

Examples

Sonic Gesture in an example performance setting:

Demonstration of all chromatic scale solfège hand signs: