A graph reasoning method for multi-object unordered stacking scenarios

Abstract

In order to enable the robot to safely pick the target object from it in the face of a scene with multiple objects stacked in a disorderly manner. It is of great importance for intelligent robot grasping to get the operation order by obtaining the position relationship between the target object and other objects in space. In this paper, an end-to-end detection inference network is proposed, in which features are extracted from the input RGB information by EfficientNet-B0 combined with BiFPN in terms of feature extraction, and in terms of operation relationships, object pairs without up-down position relationships are first eliminated to reduce the amount of operations, and graph attention networks (GAT) are later used to reason about the positions between objects. The network model is trained and tested on the VMRD dataset, and the experiments show that this model has good results in inference of object spatial position relationships for multi-object unordered stacked scenes.