Trying to control a robotic arm in unity but having trouble with it

[ertanturan]

Hello everyone ,

I'm trying to control a robotic arm with leap motion in unity . But , i just want to use my index and thumb fingers to control the clamps of the robotic arm. I attached the robotic arm prefabs into the handmodels > fingers but it didn't work as i expected. My goal is to create a simulator like https://www.youtube.com/watch?v=teRQr2qquJA&t=431s with leapmotion . The goal is not to use joysticks and something other .

In short : how to control a robotic arm (with clamps) in unity by leap motion.

Screenshot : http://i66.tinypic.com/ae77d4.png I attached the robotic arm to forearm but clamps doesn't work in the same way .

[HOTTHANDS]

Hi eranturan,

"Didn't work as expected" is very unclear. You alsoneed to specify which versions of Leap and Unity you are using because the most recent version of either are very different from some older versions.

Please remember that Leap Motion hand controllers should not be used for anything that is potentially dangerous for the operator... like davinci surgery arm in your video, high speed production lines, driving cars, etc.

In the older versions, you had Gestures. If you are using newer builds this logic as changed.

And is this a virtual arm built in Unity or is it a real arm that may have some specific drivers and API.

Good Luck

[ertanturan]

Hi HOTTHANDS,

First of all , it's a virtual robotic arm in unity . Unity version is 2017.3.0f3 and leap motion core version is 4.4.0 .
I'm trying to control left finger of robotic arm with my index finger and right finger of robotic arm with my thumb . I don't know how i can do this properly . I tried to attach the robotic finger to the leap hand model but it didn't work at all.

I would like to control this virtual robotic arm real-time with leap motion in unity . Pinching gesture is not something i want just because it's not working real time . I would like to give the feeling that our index and thumb fingers are one of those robotic fingers to the user.

1- https://www.google.com.tr/search?q=pinch&source=lnms&tbm=isch&sa=X&ved=0ahUKEwj68--ambzcAhVSjqQKHRfGBCQQ_AUICigB&biw=1920&bih=947#imgrc=FVqReRURTB7cLM:

2- http://i67.tinypic.com/290zz3a.jpg

During unpinch my robotic arm should open the fingers in harmony with my fingers. Same with pinching.

Thanks in advance..

[ertanturan]

I've updated the topic. I would like to hear from you if you have any advices .

Regards,

[HOTTHANDS]

ertanturan,
I have no idea what you updated... The engines are fairly stable and will work if your design is efficient.

You are the developer and you need to design your solution before anyone can help you with specific problems.

By specific, I mean:
Why can't your pincers use PINCH? What kind of colliders are you using? Which LEAP action are you applying to the pincer objects? Are you using statics or kinematics?

Unity3D is has a physics engine with rules and LEAP physics are added in as custom package imports.
Documentation, Tutorials and examples are where you will find your design answers.

Make sure you can control objects in your Unity scene without LEAP
Make sure you can control objects with your LEAP hand unity example scenes.
Then try to create a new project that imports the LEAP packages with your Scenario.

You will then have specific situations to discuss in the appropriate forum.
You will know if the problem is poor design in Unity3D or poor use of LEAP Orion.

https://docs.unity3d.com/Manual/CollidersOverview.html
https://leapmotion.github.io/UnityModules/interaction-engine.html

If you review these documents and they are not helpful, I really suggest that you get with a Unity or Leap interest group or college program and talk to an experienced developer there so they can help you with your design. College Interns are often available for projects if you are stuck and you need to get something into production.

I would encourage you to improve your design skills as this will be a very important technology for then next 5 to 10 years... It is well worth your effort.

HOTTHANDS