This may be a bit abstract but is anyone aware of techniques for mapping hand and object interactions and experiences in the design phase. As my designs for hand use in AR worlds become more complex I realize there is a need for a way to create designs, at some abstract level, that can represent postures, motions, conflicts, etc. This may be akin to mapping user interaction experiences, sequence diagrams, etc. but specific to hand and object interaction. I am also working on collaborative AR environments so it gets a bit more complex since we have multi-participant interaction.
This would have to deal with statics, dynamics, context, affordance, etc. I realize there is most likely no solution out there now but pointers to people working on, or thinking about it, would be appreciated.
I would be happy to begin working on something but don't want to replicate any pre-existing work. Any insight would be appreciated.