Exploring simple visual languages for real time human-computer interaction

Abstract

We want to explore the expressive power of visual languages that can be recognized in real time with off-the-shelf components. Real time constraints imply that we are only able to detect and track color blobs in the image. We test two basic applications: remote control of a mobile robot and gesture based music synthesis. The former requires accuracy in movements, and on the contrary, creativity is important in the latter.