Future of Music == Gesture + AI + Singing

While doing some research, I found this talk in which a musician talks about how she was able to use different gestures to compose a song. The actual talk can be seen below:

What is the first thing that comes to your mind after watching this? yes, it is amazing to see such a performance for a music fanatic. But for me it is even more interesting to see the different aspects of data fusion involved. By looking at her performance, there are a number of things that comes to my mind:

1. Hand gestures recognition using data gloves.
2. Body posture recognition using Kinect Sensor.
3. Localization of the person on stage using Kinect Sensor.

You might have noticed, that there are different hand gestures which are used to start the editing or instrument playing sequence. While the hand gestures are used to play specific notes as well, body posture specifies the different after effects/post processing. Similarly the location of the singer is used to relate it to different music effects.

This really shows the potential of natural interaction technology, and what might be achieved if new ideas are integrated into these natural interaction methods.

Reference:
http://www.kinecthacks.com/imogen-heap-talks-ableton-controlling-gloves/

OpenCV-2.4.X Binaries pre-compiled with Visual C++ support

Update (07/05/2013):
Below are the different versions of OpenCV binaries I compiled from source on Windows 7 using Visual C++ 2010

1. OpenCV-2.4.3VC
2. OpenCV-2.4.5VC

You can use either one of the above binaries and set up as follows:
 

To set these binaries up, extract the contents of this folder. Edit the SYSTEM ENVIRONMENT VARIABLES to add the path to \bin folder similar to what has been done in my previous post

Please post any problems in comments below.

Smartphone based Guidance System for Visually Impaired Person

This post is about an android application based on my publication in the following conference:

International Conference on Image Processing Theory, Tools and Applications, Istanbul, Turkey

The publication is online now and can be found on the following link:
Smartphone based Guidance System for Visually Impaired Person
( Notice: You may require IEEE memebership in order to access this paper)

For demonstration the application can be downloaded from the following link:
https://www.dropbox.com/s/ar6g91u0hbvc6xb/GuidanceSystemBlind.apk

This application uses OpenCV 2.4.2 libraries for android. Therefore it requires installation of the following two packages from Google Play Store.

1. OpenCV Manager
2. OpenCV 2.4 pack armeabi-v7a neon

After installation of the above packages you can install and run the demo software.

Recognizing Dynamic Hand Gestures

I have finished my final dissertation project, and now I am working on the thesis. The final outcome of this project is:

Currently I am working towards my thesis, after which I plan to write a journal paper, which I will share here  as well.

How to train your dragon?

toothless

No! this post is not about the dragon from the animated movie (although it's one of my favourite). However this picture explains almost everything there is about the topic. For those of you who have seen this movie, computer vision machines can be thought to be like the dragon which can not fly. You have to train it about every single incident and how it should react to each one of them in order to fly.

Yup! that's right, this post is about training. Training a computer!