Evaluating Situation Awareness in Human-Robot Teams

Abstract

New methodologies and quantitative measurements for evaluating human-robot team performance must be developed to achieve effective coordination between teams of humans and unmanned vehicles. The Mixed Initiative Team Performance Assessment System (MITPAS) provides such a comprehensive measurement methodology. MITPAS consists of a methodology, tools and procedures to measure the performance of mixed manned and unmanned teams in both training and real world operational environments. This paper shows results of an initial experiment conducted to validate the Situation Awareness Global Assessment Technique (SAGAT) methodology as part of the MITPAS tool and gain insight into the effect of robot competence on operator situation awareness as well as on overall human-robot team performance.