An interactive Augmented Reality based framework assisting operators in human-robot collaborative assembly operations

摘要

This paper proposes an interactive Augmented Reality based framework assisting operators in Human-Robot Collaborative environments where resources collaboration is required for different tasks execution. Based on its integration with the shopfloor's Digital Twin and Robotic Operation System (ROS), this framework achieves the efficient HRC in multiple aspects namely: assembly guidance provision, robot controlling, interaction with gripping tools, safety awareness, resilience in case of robot actions failure, cyber security and quality inspection result awareness. The proposed framework is tested and validated in two case studies inspired from the automotive and white good industries.