Vive and Leap Motion

[robertcedwards]

We've been super excited to build out a solution that utilizes HTC Vive and LEAP Orion.
I understand the immense tracking ability of the Vive controllers, but the allure of having hands with the Vive is too tempting!
We've imported the Unity Package from Leap and have the prefab attached to the camera rig and have it rendering the hands in front, but we're running into a few issues.
We're thinking it's a scaling issue. We can't seem to get the hands to align with the controllers.
Currently, we're holding the controllers hanging off our thumbs with our fingers out stretched so the LEAP can see our fingers. With any positional change we keep missing the mark of getting the both aligned with our virtual hands on the controllers.
Let us know if you all have any ideas as to why this might be happening.
You should be able to see our hierarchy with the screenshot below but let us know if you have any other questions about our setup.

[AlexColgan]

I'm not familiar with the Vive vamera rig, but it's important that the LeapHandController Prefab be in the same position as the Leap Motion Controller is in the real world. Have you applied an offset from the eyes? (For Oculus, this was 8 centimeters.)

We've played around with this as well, and have found that the controller models aren't quite right for Vive Pre. Altspace now supports both at the same time, and as you can see it's not quite perfect.

[BBaghdikian]

Did you managed to align both ? I'm having the same issue! Thanks a lot for your help!

[AlexColgan]

We've found that the offset on the Vive is more like 9.5 cm. In the current version of the Unreal plugin this isn't easily exposed, so you would have to dig in and set it manually. We expect that a future release will handle this out-of-the-box.

[BBaghdikian]

HI,

Thanks a lot, I've found the same offset 9.5cm. I'm using Unity, I'm not sure where should I add that offset.
I've parented my LMHeadMountedRig to my Main Camera (eye). I need to offset the Z position of the leap space to see any change but once I bring the virtual hand to where they should be by moving the leap space, the offset is different when my hands are close or far from my face.

I'm not sure where to do this change.

Thanks a lot for your quick response and your help !

[AlexColgan]

What version of Unity are you using? We have Vive support in the works for the Unity 5.4 beta.

[BBaghdikian]

I'm using Unity 5.3.4f1 / Leap_Motion_Orion_SDK_Windows_3.1.2/ LeapMotion_CoreAsset_Orion_Beta_4.0.2 / and the latest SteamVR package from the assetstore

[AlexColgan]

Since the assets have been built on Unity's native VR plugin, I'm not sufficiently familiar with the SteamVR plugin to make that call. Does your project rely heavily on the SteamVR plugin? We're very, very close to a new Core Assets release that will include support for Unity 5.4.

[BBaghdikian]

I'm currently developing a prototype that will be presented to potential partners and clients within two weeks. I've developped their factories in VR and I just want them to be able to see their hands and grab a tool (here the htc vive pads).

Are we looking at a couple of week prior release of the new Core Assets or in months? I need to present prototypes from now until september. I might start actual production during the last two weeks of august.

[AlexColgan]

Shooting you a PM.

(Filler text to satisfy forum word count requirement )

[yester]

Bump

With Vive + Unity 5.4 Beta (OpenVR integration) and LeapMotion_CoreAsset_Orion_4.1.1 we get quite a few centimeters of difference between hand model positions and the rest of the scene (eg : Putting a hand flat onto the real floor shows it hovering around 5cm above the ground), is this a know issue with Orion Beta?

[chop]

Any Solution for this? i am having the same problem.
Did you manage to setup the VIVE with passthrough?

[AlexColgan]

The more recent Core Assets packages handle this integration out of the box. There is a known issue with Orion where the skeleton hand can shift slightly away from the hand as you move left or right, and the X-axis can be somewhat skewed. But for significant discrepancies, if the VR Visualizer scene correctly aligns the tracked hands, then I have to imagine it might be related to how the Lighthouse sensors work or how room scale and the floor been configured.

[chop]

Alex, are we talking about v2 or Orion core Assets?
So you are saying that instead of using the CameraRig from SteamVR to use the LeapMountedRig ?
i think my HMD does not get any streaming when i do that, am I missing something?

[AlexColgan]

Orion Core Assets; though note that it requires Unity 5.4.

[luoyi2016]

an be somewhat skewed. But for s

I think I got the solution:

We should set Camera(head) instead of Camera(eye) to the property Head Transform of LeapVRTemporalWarping