No problem.
In the mean time, I found a solution.
So I created a new prefab mixing the solution from the Leap Core assets and the one from OVR using this post. An instance of that prefab is created when the user is spawn after connection to the server is established
I had to tweak the HandPool script so the model pool initialisation is done differently. The HandCollection is filled on the Awake with instances of prefab created at runtime (the 4 of them). So on start, everything is right and I don't have any warning.
It's worth noting that the hand themselves are not synchronised, only their general position in the scene.