Usability Questionnaire for Robotic Systems Based on the ISO 9241–110

Abstract

This paper presents the validation of a usability questionnaire tailored specifically to robotic systems, based on the ISO 9241-110 standard. The use of robotic systems in the workplace is becoming increasingly common. Hence, humans and robots interact more frequent. The quality of these interactions is significantly influenced by the robot's usability. The ISO 9241-110:2020 presents seven interaction principles as ergonomic design guidelines in human-machine interaction. An evaluation tool capable of reflecting the norm benefits both system designers and researchers. A pool of 100 robot specific items based on the ISO 9241-110:2020 and the IsoMetrics questionnaire was created and evaluated in a video-based online study. Confirmatory factor analysis (CFA) assessed which items best reflect the standards' structure. While the structure of the standard could not be fully reflected by the CFA, allowing one additional factor results in a sufficient model fit, while maintaining high content validity. The final questionnaire has 8 factors and 41 items. Its high content validity and usage efficiency makes it a valuable addition to any usability assessment toolkit, however further validation steps are needed.