zSpace 3D Display + Leap Motion

[ReinD]

zSpace is a 3D display tilted at 45 degrees. It's not VR. You wear 3D glasses with head tracking and things pop out at you in 3D as if it were in front of you. You use a pen-based mouse to interact with the objects in 3D. We're trying to see if we can replace the pen with the Leap.

The Leap controller is mounted on the bottom edge of the screen facing upward. In the Unity environment, I have to use the zSpace prefab, which includes the cameras to do the stereo projection, instead of the Leap prefab. After attaching all the scripts and hands to the zSpace prefab, it actually works, BUT the location of the capsule hands and fingers don't match/align with the location of the person's real hands and fingers. Is there any way to fix this?

Ideally, we want to visually hide the capsule hands, so that it appears that the user is just using their real hands to interact with the 3D objects.

Thanks!
Rein

[AlexColgan]

Could be a scaling issue or a problem with where the Leap Motion prefab is located in Unity space; can you send some images of the misalignment?

Ideally, we want to visually hide the capsule hands, so that it appears that the user is just using their real hands to interact with the 3D objects.

Try using the physics hand models; they're invisible to the user, as they only exist to affect the physics of things around them: https://github.com/leapmotion/UnityModules/tree/master/Assets/LeapMotion/Prefabs/HandModelsPhysical

[ReinD]

Alex,

Thanks for the reply. I tried taking a picture of my hand through the 3D glasses - and the glasses that allow an observer to see no stereo images, but it doesn't really work. I included the photos anyway.

It could very well be a scaling issues, but when I tried to scale Leap objects in the hierarchy I got all kinds of error messages about invalid values.

transform.localScale assign attempt for 'bone3' is not valid. Input localScale is { 2.000000, Infinity, 1.000000 }.

What object should I be scaling?

[Joe_Ward]

The virtual LeapHandController object needs to be placed in the virtual scene at the position matching its real-world location and rotated to the same orientation. The code uses the transform of this object to transform the coordinates of the hands into the Unity world.

In this case, since the controller is not attached to the user's head, you probably wouldn't want it attached to your stereo camera rig. Ideally, there is an object that represents the display itself and you could make the LeapHandController a child of it. Otherwise, it might take some trial and error to find the correct position and rotation -- and would also not be repeatable.

[ReinD]

Thanks, Joe!

I detached it from the camera rig and it works much better. A bit more trial and error, some controls for adjusting position and scale, and it should be ready for some alpha testing.