Real-time vision-based control of swing motion by a human-form robot using the remote-brained approach

Abstract

We present a vision-based real-time control system of a human-form robot in swing motion. The robot has 16 DOF joints and a camera which is designed to do research on human-form robot behaviors. The key idea to develop the vision based system for the robots are the remote-brained approach and real-time visual tracking. In this approach, the robot system is designed to have the brain and the body separate and to connect them by a radio link. The body sends the visual image to the brain and the body receives the motion, references. The basic algorithm to observe the swing motion by vision uses the optical flow generation. The control algorithm for flow-based visual feedback is described.