Effect of Human Interaction Modalities on the Usability and Performance of a Robotic Cyber-Physical System for Construction Progress Monitoring

Abstract

The construction industry has been slow to adopt advanced technologies like Cyber-Physical Systems (CPS), underscoring the necessity for a human-centered approach to their development. This study aims to understand the significance and impact of human-CPS interaction modalities on human perceptions of CPS, specifically in the use case of construction progress monitoring. A mixed-method approach comprising quantitative observations and qualitative interviews was employed to evaluate the system's usability and performance with different human-CPS interaction modalities. The findings reveal variable levels of usability and performance across different human-CPS interaction modalities. Users expressed a preference for the three-dimensional immersive environment compared to a two-dimensional setting due to a better sense of presence. However, they experienced heightened cognitive load when utilizing novel interaction methods such as hand gestures and voice commands. Interestingly, despite this increased cognitive demand, users exhibited comparable performance in the assigned task, irrespective of their familiarity with the interaction modality. The results underscore the importance of human-centered design in CPS development. It contributes empirical evidence crucial for understanding and improving human-CPS interactions, thereby advancing the implementation of CPS in construction progress monitoring.