Improving Human–Robot Collaboration through Augmented Reality and Eye Gaze

Abstract

When humans work together to complete a joint task, each person builds an internal model of the situation and how it will evolve. Efficient collaboration depends on how these individual models overlap to form a shared mental model among team members; shared models are also important for collaborative processes in human–robot teams. The development and maintenance of an accurate shared mental model requires bidirectional communication of individual intent and the ability to interpret the intent of other team members. To enable effective human–robot collaboration, this article investigates the use of augmented reality (AR) technology and user eye gaze to enable bidirectional communication of intent in a joint action task. We tested this approach through a user study with 37 participants and found that this communication improves task efficiency, trust, as well as task fluency. We conclude that using AR and eye gaze to enable bidirectional communication and support shared mental models is a promising means for improving collaboration between humans and robots.