[SOLVED] Please Help me...I feel like I have a simple question without a simple answer

[pmoodie]

Hello all!
I am an scientist looking to export out the coordinate data from the leap motion device. I started with the 'visualizer' and it is awesome (seriously amazing). That being said, I can see everything I want using the "l - toggle tracking info, processing latency" but, I can not record a movement/gesture. You can 'data pause'-- but not record! Come On! I have read about all of the tracking abilities and bone id's--crazy stuff. Just no app to record the movement. I am looking for a simple "record" and an "export" function. It seems so simple, because everything is there and streaming--just can't record the file... Perfect World* the visualizer adds in one more hot key to record the movement. Boom, done. Maybe it is there and I am missing it.

I have looked at all the apps online and no one records a file. How has no one created this , seriously!? I really do not care about the file format. I just need the data.

Any help with this would be much appreciated, Thanks in advance.

[tylerz]

http://www.jaanga.com/2013/09/javascript-app-to-record-save-and.html

[pmoodie]

That was a great answer. I appreciate the quick response. I was able to collect data and save it in two different formats. However, I think that software is collecting based on a older version? Based on the new updates in tracking I think there is a difference. I contacted the developer and I hope to hear back soon.

It is exactly what I was looking for, I think it is missing the updates.

Thanks for the help!

[Komposten]

Exactly what data is it you want? Only the coordinates of each finger and their respective speeds, or more than that?
And what kind of format would you prefer to have it stored in?

[Joe_Ward]

All the sample applications in the SDK (except Sample.html) print out tracking data to the console. It would be trivial to modify these to print out exactly the data you wanted and either write it to a file directly or you could pipe the standard out put to one. Adding record/pause on a keystroke should also be pretty simple.

[pmoodie]

Coordinates of the finger and respective speeds are exactly what I want. If I could get all bone 3D locations, vectors, matrix data (?) that would be great. General data formats like JSON or BVH would be fine. I would prefer to work in XML.

Overall, if I could get all the data that is streamed to the 'visualizer' recorded I would be extremely happy.

[Komposten]

@pmoodie
I wrote a small program to record hand and finger data and store it in JSON format. The program will always be displayed on top of other windows, so it can be used at the same time as Leap Motion's visualiser. It saves the following information:

• The frame id
• Hand information (id, direction, palm position, palm normal, palm velocity)
• Finger information (id, direction, tip position, tip velocity)

The finger information is stored within the hand objects (but this can be easily be changed).
If you're interested, check it out: https://www.dropbox.com/s/onhfddjy3023ikv/LeapRecorder.zip
If you want me to change anything (like adding bone and joint information), just ask.

[pmoodie]

I got the file from your dropbox, but I am having a tough time running it. Not sure what I am doing wrong, but if you could give me any insight on any error checking I can do I would appreciate it. Thanks for the application!

[Komposten]

Oh, forgot about that. You'll need Java to run it, and it uses 64-bit libraries, so if you have a 32-bit OS I will have to change those libraries to 32-bit. And I've only tested it on Windows, so if you use another OS, let me know.

I'll add a logger to it tomorrow so we might catch any errors that might appear.

[pehrlich]

@pmoodie @Komposten @Joe_Ward We have a web-based record and playback tool, available here: http://developer.leapmotion.com/recorder

We used this to make the recordings on the What's New page in the developer gallery. It allows record/crop/playback, and saves the JSON in a compressed format.

[Komposten]

@pehrlich
Well, at least it was a good experience for me to write my own little recorder. I'd never worked with JSON before, but now I know both what it is and how to use it.

(And it works offline, though maybe the official recorder can be downloaded as well?)

@pmoodie
If you're still interested in trying my software, even though Leap Motion's is undoubtedly better, I've updated the .zip file on Dropbox to include automatic error logging and a 32-bit version (if you use 32-bit OS).

[pehrlich]

@Komposten Thanks for sharing you project! Feel free to post it to the developer examples gallery, where people will be able to find and use it.

Also - the JS one is by no means perfect or "done" - feel free to make suggestions or changes on the github.

PS When I try and run it I get an error. Is Java 7 required?

java -jar LeapRecorder/LeapRecorder-x86.jar 
Exception in thread "main" java.lang.UnsupportedClassVersionError: komposten/leap/data/DataRecorder : Unsupported major.minor version 51.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(ClassLoader.java:637)
at java.lang.ClassLoader.defineClass(ClassLoader.java:621)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)

[Komposten]

@pehrlich
It seems that it is required, yes. Though that was not my intention, so I'll fix that and make it compatible with Java 6 as well.
Edit: It seems that I can't access any of the downloads for JRE 6 without an Oracle account (which I'm not interested in getting), so I believe it will require Java 7 for now.

[wazmackenzie]

Does anyone know how to convert the JSON data to FBX / BVH skeletal data...

I want to use the hand animation for character animation and cannot use JSON

[Joe_Ward]

@wazmackenzie ASFAIK, you need to manually choose the which bones in your rig match up to the bones in the Leap Motion hand model and update those bones each frame as you receive data from the controller.

[lm_dedelhart]

check out http://www.jaanga.com/2013/09/skin-and-bones-for-leap-motion-devices.html -- note he was workign with our old API which just has fingertips and palm data. But thats the best example I can find.

[lm_dedelhart]

Also some notes on the new hotness, the skeletal api:

All the joint positions and rotations are ABSOLUTE/world coordinates.

In most skinning/boning systems you'll have to deal with relative coordinates. this means at the least, subtracting palmPosition from the joint positions.

Relative rotations are a VERY complex calculus. I recommend making the palm's visible artifact a child of root and rotating it, rather than rotating the hand root,

Personally I find it easier to work with spheres and cylinders for which angles are not nearly as important.

[pmoodie]

To everyone that posted to this question. Thank you. I have received awesome support and have a lot of usable solutions. I am currently working on a biomechanics model for this to be used in a variety of situations, and when it is completed I will be sure to updates this community posting.

If you or know of anyone needing assistance in the biomechanics model please feel free to post or send them my way. I would love help.

Thanks again everyone!

[jthteo]

Hi pmoodie,
Am a neuroscientist and doctor who has a small working LeapJS recorder but using version 1 running on node.js.
My limited coding experience means I am very slow in updating it for the Skeletal Tracking. It would be helpful to join forces with others working on this. I am based in UK.
You can email me off forum if preferred.

[francescomarino]

I tried to use your page and it is really fantastic. However it is very difficult to me to "read" the exported file: have you a description of the lines given as an output? I think it is controlling and exporting something like 140 variables: is it correct?