LeapCV - Computer vision library for leap motion

Tags: #<Tag:0x007f1f702da870>

danhamilt1 2015-03-17 00:47:55 UTC #1

Hello All. I am currently working towards my final project at university and made the decision to implement a simple to use computer vision library for the leap motion.

It is going to make extensive use of OpenCV and once I have finished with it myself I will release it into the wild for somebody to do properly!
I hope to essentially try and make OpenCV a little less scary for people (like me) that are new to computer vision or looking to have a play around with it.

I am kind of just toying with it for now, making it do things I want it to but I have had some pretty interesting results so far!

If anyone has any interesting ideas for the leap motion outside of its current tracking API, please reply!

alexopalka 2015-03-26 22:44:45 UTC #2

This is kind of cool and I would be interested in checking this out more when you are at a more defined state in terms of ready to release the library into the wild for us to play with.

zars15 2015-07-01 21:05:23 UTC #3

Oh wow, I'm actually really interested in this. A while a go I had idea to try and use leap motion for head tracking instead of hand tracking, but I have no idea where to start with OpenCV or other image processing tools. I really hope you're still developing this.

Ors 2015-07-03 13:18:04 UTC #4

Hi Dan,

Interesting project! Please make sure to let us know how it goes as you progress. Cool stuff!

chop 2015-11-08 03:41:08 UTC #5

very interested in the end result i quited OpenCV not because it was a pain!!! but because light affected to much your project during live tracking.

How much movement and object detection have you tried as this are not regular webcams

pancur 2016-03-17 12:36:23 UTC #6

Any updates on this subject?

sattar_asd 2016-08-23 19:09:57 UTC #7

Hi, I am using leap motion to create 3D handheld scanner. Firstly I have to calibrate the cameras that sucks my mood. I am still stuck on calibrating cameras by chessboard using opencv.

Joe_Ward 2016-08-23 19:33:24 UTC #8

One of our computer vision experts mentioned to me awhile ago that calibrating the cameras with OpenCV was possible, though difficult. He did say that the pinhole camera model typically used in OpenCV wasn't a good starting point. The Leap cameras are wide angle, with complex distortion. (Sorry, I can't help beyond that as my knowledge of the subject is extremely limited.)

sattar_asd 2016-12-08 19:03:45 UTC #9

@ankababubilla I have done camera calibration and successfully got parameters for depth map, you can check below my depth image result. The only thing left is pointcloud , anyone here who have done pointcloud creation ? I would be very helpful to me

Stereo calibration using OpenCV

danhamilt1 2016-12-08 20:40:35 UTC #10

Woah that depth map is so much better than anything I ever got out of openCV. Well done!

I kind of gave up in the end, finished uni and never wanted to touch my code again! However, I do have something that MIGHT help you with a point cloud. I did manage to get some out but they were never amazing. Here is my code - be warned, it is terrible, poorly undocumented, and it became a rushed final year project in the end!

https://github.com/danhamilt1/LeapCV

dholz 2016-12-09 01:40:54 UTC #11

You shouldn't need to calibrate the cameras. We provide unwarp maps as part of our api.

danhamilt1 2016-12-09 08:35:31 UTC #12

Hi David. Yes I personally ended up using those maps. Partly because I had no success with open cv calibration myself.
Can't quite remember how I did it but I ended up putting the values the camera supplied into openCV (somehow) for extremely fast dewarping. At the time there was a warning on the dewarping method in the leap motion api saying that it was slow (which yes - it was!!).

sattar_asd 2016-12-09 18:19:43 UTC #13

Thanks for the help.I will give it a try