How can I receive leap motion framework from websockets in Unity

Khm 2016-04-13 10:18:33 UTC #1

I send my leap signal to websockets, and I want to receive that signal in unity.

How can I do this?

I sent signals that make leapmotion to websockets, like that
{"currentFrameRate":52.3138,"devices":[],"gestures":[],"hands":[{"direction":[-0.965687,-0.00515748,0.259657],"id":13,"palmNormal":[0.0194527,-0.998431,0.0525147],"palmPosition":[52.7248,76.3451,-6.86386],"palmVelocity":[9.45591,17.6745,-12.9938],"r":[[0.986754,-0.132931,-0.0929847],[0.144464,0.980818,0.130865],[0.0738050,-0.142565,0.987030]],"s":0.798240,"sphereCenter":[1.02287,123.221,-31.6209],"sphereRadius":75.8099,"stabilizedPalmPosition":[46.2970,75.1449,-8.16901],"t":[19.8326,-7.84440,4.49076],"timeVisible":6.37306}],"id":98978,"interactionBox":{"center":[0.00000,109.324,0.00000],"size":[128.591,128.591,80.7638]},"pointables":[{"direction":[-0.895822,-0.408930,0.174007],"handId":13,"id":131,"length":58.8075,"stabilizedTipPosition":[-41.0712,56.7077,36.7993],"timeVisible":6.37306,"tipPosition":[-37.6072,59.5663,37.7156],"tipVelocity":[13.3228,11.2663,-7.46866],"tool":false,"touchDistance":0.333333,"touchZone":"none","width":19.3428},{"direction":[-0.949850,-0.237518,0.203397],"handId":13,"id":132,"length":67.0064,"stabilizedTipPosition":[-62.2423,72.4949,17.3667],"timeVisible":6.37306,"tipPosition":[-56.8121,72.3412,18.9685],"tipVelocity":[12.4121,7.26847,-6.29606],"tool":false,"touchDistance":0.333333,"touchZone":"none","width":18.9972},{"direction":[-0.983904,-0.149666,0.0976367],"handId":13,"id":133,"length":64.4285,"stabilizedTipPosition":[-55.7180,71.4329,-24.6654],"timeVisible":6.37306,"tipPosition":[-54.2440,76.8523,-14.6322],"tipVelocity":[8.00413,40.9260,-9.41503],"tool":false,"touchDistance":0.333333,"touchZone":"none","width":18.0770},{"direction":[-0.989363,-0.110974,-0.0940513],"handId":13,"id":134,"length":50.5107,"stabilizedTipPosition":[-32.4621,65.3391,-48.6888],"timeVisible":6.37306,"tipPosition":[-32.6004,72.3707,-49.7977],"tipVelocity":[4.32238,27.5238,-1.66765],"tool":false,"touchDistance":0.274296,"touchZone":"hovering","width":16.0574}],"r":[[0.986754,-0.132931,-0.0929847],[0.144464,0.980818,0.130865],[0.0738050,-0.142565,0.987030]],"s":0.798240,"t":[19.8326,-7.84440,4.49076],"timestamp":1460542582499053}

and
I want to receive this signals and by using this signal I want to move leapmotion hand in Unity.

Joe_Ward 2016-04-13 17:32:59 UTC #2

You can use a C# WebSocket library; there are a few out there, but I don't know which is best. If your target platform is WebGL, though, Unity has added some WebSocket support, though it wasn't quite finished last I checked. Also, the assets themselves were seemingly too complex for the Unity WebGL compiler.

To use WebSocket-derived data with the Leap Motion Assets will take some rewriting of the C# API code.

In version 2, you would have to rewrite basically everything. For example, you can't create a Frame object; you would have to replace the existing Frame class with one that could be constructed (and rewrite all its methods and properties). The same for every other class.

In v3 Orion, the rewrite could be as simple as implementing the IController interface. (I say could because we haven't tested replacing the standard Controller class with a different implementation yet.)

Khm 2016-04-29 07:23:37 UTC #3

Thanks, I want to know 'what code is capture hand and hand motion?'
If I rewire those code , then I can use web signals to use virtual hand in unity?

Joe_Ward 2016-04-29 16:55:16 UTC #4

You would need to implement the IController interface to create Frame, Hand, Finger, etc. objects from the WebSocket data.

Tom_Goethals 2019-02-27 13:46:29 UTC #5

We're still looking to do this. Any pointers or maybe a previous implementation? having Leap data streamed in over the network to mobile android based VR goggles is the goal..