Multi modal interfaces for human robot interaction (speech, gestures)

A wearable solution using headset is developed to send commands/ interact with the robot, to send instant feedback to the operator including also audio alerts. It accomplishes a simplified programming experience with the robot. It also includes extensions to uses Kinect or similar sensors to guide and interact with the robot during Programming /setup and production (coordinating) The advantages are an enhanced interaction by simple audio commands and hand/body gestures, shorter learning curve – less training required for operators and an easy integration with different robot platforms as an external application.