Musical interactions with a perceptual robotic percussionist

Abstract

We present our approach for human-robot musical interaction using a perceptual and socially-oriented robotic percussionist. Our robot, named Haile, listens to live players, analyzes perceptual musical aspects in real-time, and uses the product of this analysis to playback in an acoustically rich manner, forming musical collaborations with human players. We conclude by proposing guidelines for pedagogy and an educational environment for learning music, math, acoustics, and programming through interaction with Haile.