Robot Strategy Transfer Based on Shared Feature Space for Search and Insertion Assembly

摘要

Traditional assembly tasks often require robots to transfer the acquired skills to new tasks. However, previous transfer reinforcement learning methods typically ignore the inherent relationship between the source and the target domain tasks. This requires a substantial amount of interaction data to compensate for this deficiency, and generally results in poor transfer effects. To address this issue, a strategy transfer method that establishes a shared feature space between the source domain and the target domain is proposed to enhance the efficiency of strategy learning on peg-in-hole assembly. Initially, by calculating the distance between each feature in the source and target domains, the features with small distance are selected as shared features. Subsequently, in order to determine the successful search state, this paper uses the jump state of contact force and the relative position between the peg and the hole as the judgment criterion. Lastly, search and insertion peg-in-hole assembly experiments are conducted to validate the generalization of the proposed strategy, demonstrating its capability to transfer from simulation to the real world.