Human-robot interaction through 3D vision and force control

Abstract

The video shows the interaction with a customized Kompa\"{i} robot. The robot consists of the Robosoft's robuLAB10 platform, tablet PC, and a Microsoft Kinect camera mounted on a pan-tilt system. A visual control algorithm provides continuous person tracking. The newly developed robot features include gesture recognition, person following, navigation with pointing, and force control, which were integrated with the Robosoft's robuBOX SDK and the Karto SLAM algorithms. The video demonstrates all the features and puts the robot in use in an everyday home scenario.