User Interaction Module

The User Interaction Module collects information about body part locations via Microsoft Kinect and monitors the orientation of a grabbed virtual tool in the VTS environment via a Wiimote-Controller. This Controller also allows the system to give a haptic feedback to the user and allows him to trigger different actions. Whenever a person is tracked the joint orientations are calculated and provided as a Motion Tracker Binary Format (MTBF) stream. Furthermore, information about the confidence of the system about the tracked position and joint orientation is provided. This additional information can be used by the system to improve the robustness and usability of the final system. For instance, if several joint orientations are flagged as inferred, the tracking is instable and the avataring should be stopped, as the jittering might be disturbing for the user.