Snap rotation to position - Sign language project

[mpar]

I am working on a sign language project and I have noticed that some hand positions are not recognized well. System will know which sign a gesture is being made but the 3d hands may not look good. The idea is to rotate the fingers to the closest position so it looks right.

Let's say user makes this gesture; thumb will not be on the right position on 3D hands, but since it recognizes which gesture is being made, I will need a method to temporary take control of finger rotations and slide the thumb to the correct position. Does the system allow modifications on bones after the Orion updates the finger positions?

[Bren]

I had a similar issue. I ended up manually rotating the joints of the rigged hand model into the poses I wanted and saving each out as its own prefab. Setup an Attachment component on the palm of your tracked hands and child your prefab. When your desired gesture is triggered, show the prefab hand and hide the tracked hand model. When the gesture ends, swap the hands back.

It's not the most elegant solution but it's better than editing rotations on each frame.

[mpar]

Thanks. That is a pretty good idea! Even though it is an improvisation, it might still look OK, and will be definitely fine for the MVP. I will just have to see it will still work since Attachment module is now deprecated.
By the way, you mentioned "editing rotations on each frame"; can you actually modify a finger on top of the leap update? I would use it to limit the overrotation of fingers without just completely stopping the hand update (leap bones are too long for fingers of most people here, so they end up over-rotating and interpenetrating)

[Bren]

In the v2 software I used to constrain or dampen individual joints on LateUpdate. Orion seems to work differently (IK?) so I haven't had success with that method.

Please keep us updated if you make any headway on this. Best of luck!