Exploring Extended Reality to Optimize Human-Cobot Interaction

Abstract

We explore the integration of extended reality technologies for advancing human-robot collaboration in manufacturing environments. Utilizing a commercial XR headset, the Meta Quest 3, we capture real-time hand and virtual object movements to intuitively control a Universal Robotics e-Series cobot. Our primary objective is to assess whether this interaction paradigm is intuitive for operators while effectively leveraging the cobot's capabilities. Data is streamed from the headset to a broker using MQTT. A local computing module subscribes to the data, translates coordinates into the robot's workspace, and generates control instructions for the cobot. Preliminary findings suggest that XR-based interaction can provide an immersive and efficient framework for human-robot collaboration. These results set the stage for further exploration of multi-user and multi-robot scenarios.