MINERIC toolkit: Measuring instruments to evaluate robustness and intuitiveness of robot programming concepts

摘要

One challenge to provide the manifold benefits of a robotic system to domains like private households or small enterprises is to give non-experts an easy-to-use interface to program such systems. Although there are many intuitive robot programming paradigms, there is no general set of evaluation tools to compare them in detail. In this paper we present a toolkit to evaluate robot programming concepts. This toolkit concerns in particular the intuitiveness of a programming interface and its robustness regarding the results from generated programs. We will explain which questionnaires are necessary to analyze both aspects and suggest how to design a user study. Furthermore we provide two case examples to demonstrate the analysis and interpretation of data. As such we hope to engage robot programming developers in evaluating the acceptability of their approach, find strengths and weaknesses and finally improve the design of robots.