I think I found a fix, but I'm not sure if it will have any negative side consequences..
Unity -> Edit -> Project Settings -> Script Execution Order ..
Then make all the leap motion scripts execute after the DefaultTime.
This seems to have fixed my hands always lagging into the camera when moving the camera.
If there any negative consequences I will report back, or if anyone knows of any.. please do respond!