Unreal Multiplayer and body state anim instance

[JordanDraper]

Hi, I am working on an unreal engine multi-player game.

I have 4 computers and 4 headsets with leap motion tracking enabled.

I want each player to have hand tracking for their pawn and be able to move their hands around and see other people independently moving their hands around also. My pawn is successfully rigged and is able to pick objects up etc.

My issue comes when another pawn (player) is loaded into the level. Me moving my pawns hands around starts to move their pawns hands around on my local game. I presume this is because in the Body State Anim Instance it is grabbing that data and performing the transformations.

My question is how can I set it up to only move my pawns hands when there is data coming from my own tracker. I am aware of the multi-device branch on github but am unable to get it working so that anim instance data does not move other instances of the pawn.

Thanks in advance

[dankirby]

Hi Jordan,

out of the box, our hand tracking animation blueprints don't support multiplayer. To add multiplayer, the hand bone rotations and optionally positions need to be replicated up from each client to the server, and then downwards to each client, and the server itself, if not running as a dedicated server.

Then the animation blueprint (for example LeapLowPolyLeftAnimBP), needs modifying such that each remote player's animation runs from the replicated bone state, rather than the local Leap hand data. This can all be done from blueprint.

Each local player's animation can stay the same as it'll read the local leap hand data.

If using the Bodystate based blueprints, this will be more complex as the multiplayer implementation would need be done in C++ between the player pawns and the BodyStateAnimInstance class.

I hope this helps!