# detecting the x and y co-ordintes of a hand and finger from webcam

13 views (last 30 days)
Hashem Burki on 9 May 2011
is it possible to detect the x and y co-ordintes of a hand and fingers from webcam?

Sean de Wolski on 10 May 2011
Yes.

Walter Roberson on 10 May 2011
No, not unless their hands are very unusually shaped such that each finger can be distinguished no matter what the rotation angle of the hand.
For example if I relax my hand and move it freely around, the little finger (5th) is commonly hidden by the middle (3rd) finger, and the 4th finger between them is often only visible as a small sliver of finger tip poking out from underneath the middle (3rd) finger.
You might be able to use two webcams together to resolve this problem.
Note that the web cam will need to be either quite high resolution or focused very carefully on the hand (probably with automatic tracking) in order to be able to reliably distinguish the fingers from each other.
Sean de Wolski on 10 May 2011

Hashem Burki on 11 May 2011
Can anyone direct me on how it could be done? thanks.
##### 2 CommentsShowHide 1 older comment
Walter Roberson on 11 May 2011
In view of the previous responses, you need to clarify your goals.

Hashem Burki on 22 May 2011
i want to track my hands and fingers on a webcam. I have used the skin segmentation code to detect the hand. After applying that, what i see is the hand as plain white and the background as black.(Its not perfect and somewhat noisy). Now i want to recognize the fingers and track their movement. How can i get their x-y coordinates?
Walter Roberson on 23 May 2011
If you need to be able to recognize the individual fingers in each picture and you only have a single point of view, then you cannot do this with visible light.
(I would not rule out possibilities such as using infrared and measuring subtle differences in temperature as the fingers are likely to have different temperatures due to different blood flows because they are different sizes... but I think you are likely to have the same kinds of problems with infrared as you have with visible light.)

Image Analyst on 25 Sep 2011
I suggest you look at the many, many papers on gesture recognition, section 21.4 in: http://iris.usc.edu/Vision-Notes/bibliography/contentspeople.html#Face%20Recognition,%20Detection,%20Tracking,%20Gesture%20Recognition,%20Fingerprints,%20Biometrics There are also papers there on tracking such as this section "21.4.2.4 Hand Tracking for Gestures."

### Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by