The user experience in industrial human-robot interaction: A comparative analysis of Unimodal and Multimodal interfaces for disassembly tasks

Abstract

• Evaluates how unimodal and multimodal interfaces impact operators’ cognitive and emotional responses during disassembly tasks, using EEG data for objective measurement along with perceptual and performance metrics. • Demonstrates that multimodal interfaces not only reduce cognitive workload and memorization needs but also enhance operator performance and well-being, making them more accessible and effective for satisfying human-robot collaboration. This aligns with Industry 5.0′s focus on personalizing technology to human needs. • Advocates for the integration of comprehensive physiological and perceptual measurements to optimize interface design, ensuring technology adapts to diverse user needs and enhances overall user experience in industrial applications. In the Industry 5.0 context, ensuring effective Human-Robot Interaction (HRI) is key to supporting human involvement in production processes. Interfaces are the foundation of this collaboration and serve as vital communication channels which bridge the gap between users and robotic systems. This study compares unimodal and multimodal interfaces and their impact on user experience (UX) in an HRI context. Unimodal interfaces, while simplifying implementation, may restrict the richness of communication, while multimodal interfaces provide detailed and flexible interaction, enhancing the conveyance of complex information. However, designing effective multimodal interfaces presents challenges due to their inherent complexity in managing multiple modalities. This paper presents an HRI disassembly case study comparing the impact of these interfaces on the UX. A methodological approach was used to monitor operator performance, physiological responses, and perceptual responses. An electroencephalogram was employed to objectively record the operators’ emotional responses of operators without interrupting or hindering the process. Twenty participants (10 men and 10 women) were involved in the study. The results indicate that levels of memorization and mental workload are lower when using the multimodal interface, a finding consistent across men and women. These findings suggest that the multimodal interface is an appropriate choice, not only for reducing memorization and mental workload levels, but also for its inclusive approach. This aligns with the objectives of Industry 5.0, promoting the development of technology that meets diverse user preferences and abilities, thereby ensuring greater accessibility and a more user-centric technological landscape.