Food for brain:
If you are going to implement your own gesture detection would you rather use image analysis or use algebra on the "trackables" (fingers, etc)?
Cheers,Martin
For many types of gestures a machine learning approach like LeapTrainer.js (super old repo, just an example!) on the tracked data would be a better bet.