Sign Language To Text and Speech

[papa-jani]

Hi,

Story : I am new to Leap motion development. I am doing BS-Cs and I am assigned Sign Language To Text and Speech as my final year project. For the first phase of my project I am assigned to Translate English alphabets to Text. I've started working and learnt the basics and successfully converted two alphabets 'A' and 'C' to text, but the gesture for 'F', that involves index and middle finger to collide and the thumb to touch the ring finger, is creating problem.

Question : How can I detect that index and middle fingers are colliding each other ?

Note : The gesture is exactly equals to the victory gesture but the index and middle fingers closed.
And also if you can provide me some relevant material to my project.

http://www.google.com.pk/imgres?imgurl=http%3A%2F%2Fwww.pc-freak.net%2Fimages%2Fcrossed-fingers-sign-of-the-cross-resembles-the-salvation-of-mankind-through-Christs-crucifix.jpg&imgrefurl=http%3A%2F%2Fwww.pc-freak.net%2Fblog%2Fchristian-origin-crossing-finger%2F&h=319&w=300&tbnid=YtyVbdryDV0hHM%3A&zoom=1&docid=y2vb_czinaFA1M&ei=U7rGU6eECKi70QX1i4GIBw&tbm=isch&ved=0CBkQMygAMAA&iact=rc&uact=3&dur=687&page=1&start=0&ndsp=22

Thanks in advance .

[katem]

Hey there,

Welcome to LM development! Can you provide a picture of the gesture you're trying to replicate? That would be helpful. Thanks.

[pehrlich]

Which language are you using?

Essentially, you want to measure distance between any two joints. In javascript, it might look something like this pseudocode:

  var delta = Leap.vec3.create()
  Leap.vec3.sub(delta, hand.thumb.distal.nextJoint, hand.middleFinger.proximal.nextJoint);
  var distance = Leap.vec3.length(delta);
  if (distance < 30) // mm...

[papa-jani]

thank you for quick replies. I've added the link to the image of gesture. This gesture is what I want to translate. And any helpful material relevant to my project will be very helpful.

[papa-jani]

thank you for quick replies. I've added the link to the image of gesture. This gesture is what I want to translate. And any helpful material relevant to my project will be very helpful.

http://www.google.com.pk/imgres?imgurl=http%3A%2F%2Fwww.pc-freak.net%2Fimages%2Fcrossed-fingers-sign-of-the-cross-resembles-the-salvation-of-mankind-through-Christs-crucifix.jpg&imgrefurl=http%3A%2F%2Fwww.pc-freak.net%2Fblog%2Fchristian-origin-crossing-finger%2F&h=319&w=300&tbnid=YtyVbdryDV0hHM%3A&zoom=1&docid=y2vb_czinaFA1M&ei=U7rGU6eECKi70QX1i4GIBw&tbm=isch&ved=0CBkQMygAMAA&iact=rc&uact=3&dur=687&page=1&start=0&ndsp=22

[katem]

Thanks for elaborating. @pehrlich is investigating the best route to take for this.

[pehrlich]

Made a new example:

https://developer.leapmotion.com/libraries/finger-angle-signed

From the description:

By comparing the cross of the finger directions to the palmNormal, we give
a sign to the angle. See This Thread for details.

Without doing this, crossed fingers and the peace sign would look the same.

EDIT: Made another example, which draws arrows for bone basis vectors: https://developer.leapmotion.com/libraries/bone-basis-arrows

[omdesign]

Please let us know how it goes. There are also student projects at RISD working on similar. You might even have better luck using actual signs! Having a whole concept conveyed might be easier and more interesting than spelling everything out, especially with how fast most signers spell. You could conceivably tell a few interesting stories with maybe ten signs.

[papa-jani]

Sure i'm working on it. I'll update.

[monerafm]

hello
dear i'm working on the same project for my graduation , please can you help me with it .

thanks
best regards
Monrea

[winechit]

I am also working on it. What kind of Development Tools (Programming Language) I should use? Currently I am using Javascript.