EAC-HRC: Emotion-Aware Communication for Human-Robot Collaboration in a Music Orchestra System

摘要

This research investigates the integration of Emotion Aware Communication in Human-Robot Collaboration (EAC-HRC) within the context of orchestral conducting. As robotics evolves from traditional human-robot interfaces to collaborative teaming models, there emerges a critical need for robots to interpret emotional cues in communication effectively. This research proposes a framework for audio-to-emotion recognition in musical settings where a robot conductor interacts with human musicians, transitioning the robot’s role from a mere tool to a collaborative teammate. Through a mixed-methods approach incorporating audio-emotion sentiment analysis, paralinguistic features and acoustic feature analysis, this research work elaborates a new enhanced synchronization. Our findings establish a foundation for advancing HRC in artistic domains, offering insights into creating more intuitive and emotionally resonant collaborative experiences.