3D Gesture Search Demo v1.1

Gesture search application, now with Mondrian background.

This version lets you select whether to search in 2D, 3D or both and also shows or hides the scores so it can be used for both testing and have a clean interface.

I'll add in some annotations so you know what's happening at each point.

Oh and please note, the frame rate and glitches are due to the screen recorder rather than the app itself :)

Gesture Search App Nearly Done!!!

Would you bloody well look at that! I've only gone and built it!

Have a butchers at the Gesture Search application, letting you search with your hands for those things you just can't quite remember the names of like...... errrr....... uuhhhhh......... coffee tables!

Obviously it needs to be made pretty, but Rome wasn't built in a day and sadly neither was this.

KInect fully tracked hands and head, resizing with depth

As i wanted to do, I've isolated the head and hands, tracked them quite well and put the ellipses from previous tests over the top.

The ellipses are now resizing with depth quite nicely as well.

I guess next is placing 3D tracks of the hands and then working out a good solution to save the tracks to file.

Kinect Skeleton overlayed onto the video stream

I've now tweaked some stuff to get the skeleton working with the depth reading to ensure that it maps properly on top of the person in the video, rather than the issues shown in the last video.

Hopefully next steps are removing the full skeleton, adding some hand glow and then adding the tracks to build the models.... Nice...

Resizing circles with depth of hands and head with kinect

I've got the kinect all working now, and am tracking my hands and head with some circles. And I've overlaid them on top of the raw video.

Something i noticed with the tutorials:
http://channel9.msdn.com/Series/KinectSDKQuickstarts/Skeletal-Tracking-Fundamentals

Is the fact that the tracking doesn't take into account how far you are from the sensor. So i've added some code that changes the size of the circles depending on the distance.

Next i need to change the code so the circles move less when you are further away. You'll see that, at present, when you get further away, they still try to fill the screen.

Skeletal data

http://channel9.msdn.com/Series/KinectSDKQuickstarts/Skeletal-Tracking-Fundamentals

Kinect API

Data Miming

http://www.christianholz.net/data_miming.html

http://research.microsoft.com/en-us/um/people/awilson/publications/HolzCHI2011/HolzCHI2011.pdf