Emotionally Assisted Human–Robot Interaction Using a Wearable Device for Reading Facial Expressions

Abstract

Abstract In this paper, we introduce a novel paradigm of emotionally assisted interaction between humans and robots. We present a personal wearable device that can be worn on the side of the face to unobtrusively and continuously detect physiological signals that are a mixture of facial electromyographic signals. Through real-time pattern classification, facial expressions can be identified from them and interpreted as positive and negative responses from a human. We report on successful facial expression identification using Independent Component Analysis and an Artificial Neural Network, and show the design of the interface device that can be used for coaching a real robot. Keywords: human–robot interactionemotional roboticswearable interfaceelectromyography