EyesWeb-toward gesture and affect recognition in dance/music interactive systems

Abstract

The EyesWeb project concerns the development of a system for real-time analysis of full-body movement and gesture of one or more humans, with a particular focus on affect or emotion content. Such information is used to control and generate sound, music, visual media, and to control actuators (e.g., robots). The main goal is to explore extensions of music language toward gesture and visual languages. The paper describes the state of the art of the project, the design of the current EyesWeb system modules (hardware and software), their experiments in public events, and discusses ongoing developments.