A Comprehensive Methodology for Assessing Human-Robot Team Performance for Use in Training and Simulation

Abstract

New methodologies and quantitative measurements for evaluating human-robot team performance must be developed to achieve effective coordination between teams of humans and unmanned vehicles. The Mixed Initiative Team Performance Assessment System (MITPAS) provides such a comprehensive measurement methodology. MITPAS consists of a methodology, tools and procedures to measure the performance of mixed manned and unmanned teams in both training and real world operational environments. This paper describes MITPAS and the results of an initial experiment conducted to validate the measures and gain insight into the effect of robot competence on operator trust as well as on human-robot team performance.