Human Computer Interaction System for Impaired People by using Kinect Motion Sensor : Voice and Gesture Integrated Smart Home

Abstract

Gesture and speech based Human computer interaction is one of the most natural and convenient way of communication which leads to minimize the gap between human and machine. In this paper, we propose a single HCI system which can be utilized by people with physical challenges as well as speaking and hearing disabilities. Voice and gesture commands acquired by Kinect motion sensor are availed to manipulate home appliances via a Wi-Fi enabled wireless network hub. Even though nowadays, there is a pool of HCI systems with various technologies, cost and accuracy of those systems are debatable factors. Experiments carried out in the evaluation process reveal that our system provides more than 80% of recognition accuracy in gesture mode as well as in voice mode. Moreover, it can work well in uncontrolled, environments.