E-Bot: A Facial Recognition Based Human-Robot Emotion Detection System

Abstract

There are many Emotion Detection Systems which can understand emotion but are only present for monitoring purposes. Emotional Robots currently available predict emotion with low accuracy. Thus there is a requirement for Emotion Detection Robot which can predict emotion of user with high accuracy. The robot should converse with the user based on their emotion. It should be a companion for the user. In this paper we present the development of the E-Bot system, which enables human-robot interaction based on emotion detected from facial recognition. A mobile app is developed to control the robot and guide the chat. The Google Cloud Vision API and Pre-trained Facial Expression Algorithm are explored and the prediction accuracy, sensitivity and specificity of these two approaches are summarised in this paper. Results show that the proposed E-Bot system could be applied to provide affective care for people living alone at home.