Abstract:
Gesture and speech based Human computer
interaction is one of the most natural and convenient way of
communication which leads to minimize the gap between human
and machine. In this paper, we propose a single HCI system
which can be utilized by people with physical challenges as well
as speaking and hearing disabilities. Voice and gesture
commands acquired by Kinect motion sensor are availed to
manipulate home appliances via a Wi-Fi enabled wireless
network hub. Even though nowadays, there is a pool of HCI
systems with various technologies, cost and accuracy of those
systems are debatable factors. Experiments carried out in the
evaluation process reveal that our system provides more than
80% of recognition accuracy in gesture mode as well as in voice
mode. Moreover, it can work well in uncontrolled, environments.
