Human motion caption with vision and inertial sensors for hand/arm robot teleoperation

Abstract

The multi-fingered robot hand has much attention in various fields. Many robot hands have been proposed so far. A teleoperation system for the hand/arm robot allows intuitive manipulation of the hand/arm robot. This paper deals with a motion capture system for controlling the hand/arm robot remotely. Here, we use vision and inertial sensors simultaneously in order to detect the position and the posture of an operator's arm and hand.