Online hand gesture recognition using neural network based segmentation

Abstract

In this paper, we propose an online hand gesture recognition algorithm for a robot assisted living system. A neural network-based gesture spotting method is combined with the hierarchical hidden Markov model (HHMM) to recognize hand gestures. In the segmentation module, the neural network is used to determine whether the HHMM-based recognition module should be applied. In the recognition module, Bayesian filtering is applied to update the results considering the context constraints. We implemented the algorithm using an inertial sensor worn on a finger of the human subject. The obtained results prove the accuracy and effectiveness of our algorithm.