Mobile shopping cart application using kinect

Abstract

This paper presents a novel application of a perception sensor Kinect to a mobile shopping cart (MSC). We attempt to exercise daily-used instructions as commands by using skeleton tracking of the Kinect sensor. A pair of differential-driven wheels together with dynamical system is mounted on the chassis of the shopping cart, which reshapes the shopping cart as a mobile robot. The commercialized Kinect sensor is employed to detect the gestures of the human body. The mobile shopping cart equipped with Kinect could execute different gesture command, for example, go ahead, draw back, set stop and so on. The response time is within 0.5 second. To do the right reflexes, we define a set of trajectory determined by the gesture of the target customer. The experiment result shows the validity of proposed method.