A Human-Robot Interaction for a Mecanum Wheeled Mobile Robot with Real-Time 3D Two-Hand Gesture Recognition

Abstract

Abstract Human interaction with mobile robot becomes a popular research area and its applications are widely used in industrial, commercial and military fields. A two-hand gesture recognition method with depth camera is presented for real-time controlling the mecanum wheeled mobile robot. Seven different gestures could be recognized from one hand for mobile robot navigation and three gestures could be recognized from the other hand for controlling the gripper installed on the robot. Under the proposed control scheme, the mobile robot system can be navigated and can be operated at the same time for achieving missions by two different groups of hand gestures. The accuracy of the gesture recognition is about 94%. During mobile robot control experiment, the system works timely, accurately and stably for certain tasks such as directional movement, grasping and cleaning obstacles.