Human Activity Recognition with Convolution Neural Network Using TIAGo Robot

Abstract

This paper presents a two layer convolutional neural network for performing activity recognition. We combine spatial and temporal information extracted from images acquired from RGB cameras. Spatial information are extracted from videos by splitting them into RGB channel frames and do a one frame at a time classification. Temporal information from videos are extracted by computing their optical flow. The results are combined in order to build a real time human activity recognition system. The network is tested using TIAGo robot for performing activity recognition. The accuracy of the system is 87,05 %, that is comparable with the state of the art. Also, results are obtaining in real time.