Multimodal aspects of communication and data storage and managing systems

摘要

Sensors of different principles (modalities) generate multimodal signals. Human-to-human communication relies on several communication modalities such as speech, body gesture, etc. The role of data descriptions, i.e. metadata, is important in the discovery, analysis, management, and sharing of scientific data. Computer understandable information is one that is annotated with semantics, which describes the meaning of the information. Paper presents methods for multimodal communication and data storage and managing systems in different usage scenarios - eLearning, digital gesture database, logistics, business process, and rescue robots communication.