Human-Robots Interaction by Facial Expression Recognition

Abstract

This paper presents a facial expressions recognition system to command both mobile and arm robot. The proposed system mainly consists of two modules: facial expressions recognition and robots command. The first module aims to extract the ROI (Region Of Interest like: mouth, eyes, eyebrow) using Gradient Vector Flow (GVF) snake segmentation and the Euclidian distance calculation (compatible with the MPEG-4 description of the six universal emotions). To preserve the temporal aspect of the processing from FEEDTUM database (video file), Time Delay Neural Network (TDNN) is used as classifier of the universal facial expressions such as happiness, sadness, surprise, anger, fear, disgust and neutral. While the second module, analyzes recognized facial expressions and translates them into a language to communicate with robots by establishing command law.