Computer Vision and Kinematic Sensing in Robotics

Abstract

To use vision in a robotic setting it is important to achieve realtime performance. Real-time vision may be used to directly steer robots using for instance visual servoing techniques. In this thesis, an experimental vision setup using a stereo rig mounted on an industrial robot (ABB Irb-6) was built from ground up and then used to perform two experiments; visual servoing and collection of data for calibration of stereo rig and positioning of second robot (ABB Irb-2000) using visual feedback. The system is currently capable of achieving a ~15Hz visual feedback rate which could be easily extended into the 20Hz domain.