All gestures you can: A memory game against a humanoid robot

Abstract

We address the problem of real-time gesture recognition, and we prove that our system can be used in real scenarios presenting an original memory game; the object of the game is to perform the longest sequence of gestures that it is possible to remember. We explore the human-robot interaction field, letting the player confront a humanoid robot, iCub. Our main contribution is two-fold: on one hand, we present a robust and real-time gesture recognition system; on the other hand, we place the presented system in a real scenario, where its reliability and its effectiveness are remarkably stressed. This game has ranked 2nd at ChaLearn Kinect Demonstration Competition <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">1</sup> .