Indirect Robot Manipulation using Eye Gazing and Head Movement For Future of Work in Mixed Reality

Abstract

Most robot manipulations are guided by the worker's both hands using a teach-pendant or other gadgets. However, manipulating the robot is more difficult when both hands are occupied, which requires a new manipulation method. This study proposes a novel indirect robot interaction and manipulation method using eye gaze and head movement in mixed reality. The proposed approach has been implemented to provide hands-free robot interaction for pick-and-place tasks. The results show a promising direction for the future of work in human-robot collaboration.