Controlling robots with two cameras: how to do it properly

Abstract

We address visual servoing through a fixed stereo rig using an image Jacobian. Existing methods are based on the stacking of monocular servo image Jacobians, resulting in largely over-constrained control commands. In this paper we formally show that the epipolar constraint between two images can be taken into account explicitly. We then show that use of stereo significantly increases the quality of the servo task execution, especially where precision, robustness and smoothness of movement is concerned.