An intuitive interaction system for fire safety using a speech recognition technology

Abstract

We propose an intuitive interaction system, which is a part of Cooperative Fire Security System using HARMS (CFS <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> H), to readily deal with fire in a high-rise building. The interaction system is a bridge connecting human, as an operator, to the whole system. Utilizing a natural language processing (NLP) technology using Microsoft Kinect makes the interaction system intuitive and has human-oriented operations. Human-Agent-Robot-Machine-Sensor (HARMS) provides a distributed network so that the systems are able to communicate with a high-level communication protocol. We established a scenario to verify the interaction system along with the system as a whole. The result of the verification left several technical issues and challenges.