Phonetic Control: A new Approach for Continuous, Non-invasive Device Control Using the Vocal Tract

Abstract

Disabled people need assistive technical devices like wheelchairs, prosthesis, robotic manipulators, food-aids, that support them in daily life. If they have no more motor function the ability to control such devices is very restricted. Trough analysis of known human-computer Interface technologies we made a new approach to this topic by using the human vocal tract. We have developed a control device that is based on the pitch and duration of humming sounds generated by the user. In our research we implemented and tested the Phonetic Control to show the feasibility of this method by controlling a mouse cursor on a personal computer as well as moving objects in 3D-world simulations. Aim of the project is a control method that allows disabled people an intended and secure interaction with, a wide range of complex technological applications and life aids. This shall be realized without the need of extensive wiring, placing interfaces near or in the face or intense learning process of the user.