I have solved this issue! Turns out it was just switching the objects to kinematic! I was far over complicating it! Thanks anyway