MR Meets Robotics: A Review of Mixed Reality Technology in Robotics

Abstract

The rising interest in Mixed Reality (MR) technology in robotics and the lack of prior work in the literature of this subject motivate this review paper. Our purpose is to discuss current research and the advancement of MR applications in the context of robotics. Development in modern robots towards a more human-centric role is driven largely by enabling technology including, but not limited to, machine vision, cobots, virtual reality, and more recently, MR technology. The scope encompasses MR technology in various aspects of robotics, namely, robot vision, control and planning, human-robot interaction, multi-user collaborations, and swarm robotics. Through discussions of the benefits and knowledge gaps in contemporary development, the review is expected to provide readers with an in-depth appreciation of the state-of-the-art technology and the possibility of MR technology in robotics.