Get IR Camera Images in Unity

[AlexSpr]

I am working with the Leap Motion 4.4.0 Core Assets in Unity 2018.2 on a project that requires me to access the Leap's IR camera output and show it as a UI element on the screen (not VR) . Sadly I can not find much documentation on getting the image data from the leap service. I am trying to read through the LeapImageRetriever Class to understand how it's done but have problems understanding it's contents. I would appreciate it if someone could explain how LeapImageRetriever works, how I could just get the image data from it, or where I could find a tutorial. Thank you in advance!

[neo36]

So don't you know, how can i get grayscale left or right image from a leap motion device in c# in unity?
I am trying to construct a device from several sensors for more accurate tracking. However, I cannot analyze the result without this images ...
The photo of my device: https://drive.google.com/open?id=1kyktw20szzMKqgFQXzJT2ZkhnkLZYyFB
The data I converted to JSON: https://drive.google.com/open?id=1YhcwCr8wJVy2NWZvHMoIWuRMya9fT2KY

[dtrevillyan]

On the same GameObject that you have the LeapServiceProvider (or LeapXRServiceProvider) add the LeapImageRetreiver script. Create a new script as shown below and place it on the same GameObject:

using UnityEngine;
using Leap.Unity;
using Leap;
public class LeapImageController : MonoBehaviour
{
private Controller _controller;
private LeapXRServiceProvider _provider;
Texture2D tex2D;
public RenderTexture renTex;
private void Awake()
{
_provider = GetComponent();
if (_provider == null)
{
_provider = GetComponentInChildren();
}
if(_provider != null) _controller = _provider.GetLeapController();
}

void Start () 
{
	if(_controller != null) _controller.ImageReady += onImageReady;
    else Debug.LogWarning("Warning - Leap controller is null");
}

private void onImageReady(object sender, Leap.ImageEventArgs args) 
{
    if(tex2D == null)
    {
        tex2D = new Texture2D(args.image.Width, args.image.Height, TextureFormat.R8, false);
    }
    tex2D.LoadRawTextureData(args.image.Data(Leap.Image.CameraType.LEFT));
    tex2D.Apply();
    Graphics.Blit(tex2D, renTex);
}

}

In your Canvas create a Panel with a RawImage component. Create a RenderTexture and drag it into the Texture field of the RawImage. Also drag the RenderTexture into the RenTex public field in the Leap ImageController in the Inspector. The IR video from the LeapMotion camera will be displayed in the raw image in the UI.