Multimodal sentiment analysis applied to interaction between patients and a humanoid robot Pepper

Abstract

In this paper authors briefly summarize the concept, motivation and exemplary implementation of an IoT-based external emotion sensor, designed for the purpose of Multimodal Sentiment Analysis. The device includes Raspberry Pi, a camera and a microphone, and serves as a standalone source of information about interlocutor’s emotions, facial expressions, body language, etc. by analyzing audio, text and video.