Tracking messed up due to raw imaged flipping over

iko79 2016-12-01 12:07:41 UTC #1

Hi,

I experienced a very strange issue when I had a closer look at why my hand tracking is so awful sometimes. What happens occasionally is that the hand as visualized in my application is reaching in from the wrong direction (thus, it's rotated by 180° around the up axis. Additionally, when this happens, the up-orientation seems to flip constantly.

What I noticed now is that in these cases, the raw image data is invalid. The camera images are flipped by 180°, as you can see here in the screenshot of the diagnostic visualizer.

After I un- and replug the Leap, things are normal again.

I'm using the latest version of the SDK (3.1.3) on Windows 8.1 x64. Any ideas?

Thanks,
iko

Joe_Ward 2016-12-01 17:47:25 UTC #2

The software watches which way hands enter the field of view and will flip the images -- and hands -- around if they come from the "wrong" side. It is hard to say why this flipping is happening for you when it shouldn't. (Your images do show a rather large blob in them. Perhaps try cleaning the top with a microfiber cloth?)

A workaround would be to turn off auto-orientation in the Control Panel and make sure that the green LED on the side of the device is facing you (or facing down if you have the device mounted on an HMD).

iko79 2016-12-01 17:56:51 UTC #3

Turning off auto-orientation is exactly what I need, since for my application this feature would even lead to undesired behaviour. Thanks!!

P.S.: The German translation of the Control Panel is a bit misleading, which is why I wasn't even aware of that feature -- the description didn't seem related. It somewhat translates to "alignment" rather then "orientation", imo. Just fyi, you may want to pass this on to the translators... or maybe it's just me, I don't know. I'd actually prefer an English version, I have to go look for it.

Joe_Ward 2016-12-01 18:10:35 UTC #4

Note that hands entering from the opposite side aren't likely to be tracked well. The tracking algorithms make a number of assumptions based on the expected hand direction. I'll pass on your comments about the translation. Thanks!

Froehner 2017-03-06 09:58:01 UTC #5

Hey,
I had the same problem with the German translation of this setting. You should definitely change it to something like "Ausrichtung automatisch umkehren". The current translation suggests that the device is aligning or calibrating it self. My translation means something like "flip orientation automatically". I don't know if this is better

By the way, even when this setting is turned off, my hand flips sometimes in the upside down direction. I googled a lot but I couldn't find any software based way to set the orientation.
I'm using the RobotStage Asset from Playground in Unity 4.6.6 with C# (Windows 10).
Leap Motion Software-Version: 3.2.0+45899
Firmware Revision: 1.7.0