Multi-modal interface for communication operated by eye blinks, eye movements, head movements, blowing/sucking and brain waves

摘要

This work presents a multi-modal interface that can be used for communication of people with disabilities. The interface is installed onboard a robotic wheelchair, and provides flexibility to choose different modalities for communication by people with different levels of disabilities. Users can use the interface through eye blinks, eye movements, head movements, by blowing or sucking a straw, and through brain signals. The interface is easy to use and has a flexible graphical user interface running on a personal digital assistant or tablet. Several experiments were carried out with healthy people and people with disabilities, and the results validate the developed interface as an assistive tool to allow communication of people with distinct levels of disability.