Voice and Motion-based Control System

摘要

The Internet of Things (IoT) permits the connection of several devices to a network enabling data to be communicated over a network without direct human-to-human or human-to-computer communication. The core of IoT systems employs hardware devices, networks, cloud services and software applications. Hardware devices take input from outside the system, networks serve as a communication medium between hardware and the cloud server, cloud services store input data and software applications produce output using the cloud data. Because of the flexibility of IoT systems, it has become a popular model for modern device communication. IoT has a wide range of applications in a plethora of fields such as healthcare, manufacturing, home automation and education. To enhance usage of IoT for educators, this project is designed to implement an Arduino board alongside motion sensors and audio receiver to control a robot car by means of a cloud server, and IoT technologies. More specifically, an Arduino board will be trained using machine learning techniques to recognize a set of predefined gestures. These gestures will be stored in the cloud server, and the robot car will retrieve these commands from the cloud server reacting according to the gesture it the system has recognized. Moreover, the system integrates Google Voice API to control the robot car by pre-set voice commands. Furthermore, a web application is constructed to control the robot car by computer. This project is but a single yet powerful tool for future applications in smart classroom technologies.