Homography-based grasp tracking for planar objects

Abstract

The visual tracking of grasp points is an essential operation for the execution of an approaching movement of a robot arm to an object: the grasp points are used as features for the definition of the control law. This work describes a strategy for tracking grasps on planar objects based on the use of a homography. In particular, the homography is used for transferring (translating) a grasp from a view of an object to a second one, providing in this way a correspondence in the second view. The grasp tracking procedure combines the search of a new grasp with the translation and the evaluation of that grasp between object views. Results of the proposed grasp tracking strategy are shown in case of grasps computed for a two-finger and a three-finger gripper.