Kinect-based 2.5D touch interaction with retro-projected screen.

Kinect-based touch interaction with retro-projected screen.
This demo augment a projected screen and or a nearby table (as a giant touch pad). Distance from the surface is used in interaction (width of line). Bi-manual/ multi-finger gesture are used for scrolling.
Unlike most kinect cursors demos :
- interaction with a vertical surface, wall-based screen.
- interactions are 2.5D. Through TUIO, you can grab XY of finger but also depth.
- you dont point in the air, but relatively to a physical touchable surface.
- the setup is ultra simple, just lay de kinect on the floor along the wall, or at the height of the table, calibrate, and that's done.
This demo was developed in may 2011, but is only published now I give up the idea of improving it (see KinectFusion if you want to understant why :).
the code can be found here : www.dropbox.co...
You can find the last cpp files and the ofxKinect compiled under OSX, I used in my project. I used libfreekinect that you may have to install.
The principle of my code is simple, I used a home made finger detection from a ROI of raw image of kinect, with x axis as final x axis and z axis becoming y axis, and y axis become z axis (or angle for TUIO), the coordinates are then sent as TUIO events.
If you want more info, send an email to popok75(at)hotmail(dot)com

[@sof2300]

Hi, sorry I didn't see your comment before, I am not working on that for a long time. The code is available, you can see how fingers are detected, did you give it a try?
Only a bit of filtering is done on 2D picture of kinect, before basic finger shape detection is made, easily as kinect is already at 90° of the screen. Good luck

[@hussien1231000]

Hi
Very Nice.
Could you help me how to detect the finger touch ?
Thanks!

[@christophermathews7823]

Can you please update the code in the new version 10 of Xcode? I don’t know how to fix some of the issues