I got it to "fake" the original server in the remote machine (local on the left, and remote windows on the right. Note that leap is disconnected on the remote machine):
Is there anything else I would need to replicate in order to make it work on the remote machine?
Paperspace limits the USB redirection bandwidth a lot, and thus the problem here. Any way we could just 'switch' where the data comes from?